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Abstract 


^  This  cKsJtiCStluu,  entitled  A  Report  Generator,  develops  a  theory  of  text  generation  and  describes  an  im¬ 
plemented  computational  model  of  this  theory.  The  theory  attempts  both  domain  independency  at  the 
knowledge  level  and  language  independency  at  the  linguistic  level  by  drawing  and  expanding  upon  previ. 
ous  work  in  discourse  schema  and  grammatical  relations,  respectively.  The  implemented  system,  GENNV, 
generates  texts  by  employing  discourse  strategies  (which  occur  in  human  produced  text)  in  parallel  with 
pragmatic  constraints  (e.g.  focus  and  context). 


The  diMortiition-  begins  with  an  introduction  and  summary  of  the  research  performed.  This  is  followed  by 
a  survey  of  the  text  generation  literature  which  places  GENNY  in  the  context  of  past  language  production 
research.  Next,  the  motivation  for  the  theoretical  position  adopted  is  discussed  followed  by  detail  of  the 
theory  on  a  knowledge,  pragmatic,  semantic,  relational,  and  syntactic  level,  ^vith  illustration  of  the  prac¬ 
tical  implementation  throughout.  Results  of  GENNY's  text  production  from  two  frame  knowledge  bases 
(neuropsychology  and  photography)  are  then  presented  together  with  preliminary  interlingual  test  results 
(English  and  Italian).  GENNY  is  evaluated  with  respect  to  state  of  the  art  generators  and  is  shown  to  be 
equivalent,  and  in  some  respects  superior,  in  competence  and  performance.  In  conclusion,  the  contributions 
and  limitations  of  the  system  ate  discussed  and  areas  for  further  development  are^gn^est^d. 
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Chapter  1 

INTRODUCTION 

I  have  laboured  to  refine  our  language  to  grammattcal  purtiy,  and  to  clear  it  from  colloquial 

barbarisms,  licentious  idioms,  and  irregular  combinations. 

Samuel  J'vhneon,  1752 

The  central  aim  of  natural  language  generation  (NLO)  is  to  investigate  the  knowledge  and  processes 
-  both  linguistic  and  extra-linguistic  -  that  speakers  and  writers  employ  in  order  to  communicate  to  their 
intended  audience.  Production,  therefore,  encompasses  issues  of  deciding  what  is  pertinent  as  well  as  de¬ 
termining  how  to  organise  and  present  information  effectively.  Speakers  and  writers  must  also  select  proper 
words  and  form  appropriate  sentence  structures.  These  issues  are  manifest  in  the  questions: 

•  should  we  nhont? 

•  When  should  we  speak  about  it? 

•  How  should  we  speak  about  it? 

In  thi»  work,  a  linguistic  approach  and  computational  system  (OENNY)  are  presented  which  offer  a 
framework  from  which  the  generation  process  -  what,  when  and  how  can  be  liivestigatcJ.  In  particula^t, 
this  work  addresses  the  issues  of  pertinency,  coherency  and  grammaticality  and  demonstrates  algorithms  and 
mechanisms  for  achieving  these. 

This  discussion,  therefore,  encompasses  not  only  traditional  issues  of  syntax  and  semantics,  but  equally 
current  problems  in  pragmatics  and  discourse  theory  (c.g.  supra-senlential  connectivity  of  text).  GENNY 
demonstrates  how  these  higher  level  constraints  can  effect  the  low-level  realisation  of  language  in  a  well- 
motivated  manner. 
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1.1  Summary/ Example 

GENNY  was  built  to  answer  general  questions  about  both  the  permanent  structure  of  a  knowledge 
base  as  well  as  the  results  of  an  individual  run  of  an  expert  system  in  neuropsychology.  Three  type  of  wh 
interrogatives  were  addressed:  queries  for  definitions  (What  is  an  X?|,  requests  for  explanations  (Why  did 
you  obtain  the  result  Y?),  and  requests  for  comparisons  (What  is  the  difference  between  X  and  Y?).  For 
example,  asked  to  define  a  brain,  GENNY  responds: 


A  brain  la  a  region  for  understanding  located  in  the  hunan  skull.  It  has  a  relative 
importance  value  of  ten.  *  It  contains  two  regions:  the  let t -hemisphere  region  and 
the  right-hemisphere  region.  The  left-hemlsphere  has  a  relative  importance  value 
of  ten.  The  right -hemisphere  has  a  relative  importance  value  of  ten.  The  right- 
hemisphere  region,  for  example,  has  the  gestalt-understanding  function  located  in  the 
right  brain. 

After  loading  a  new  knowledge  base^  and  dictionary  on  photography,  we  could  ask  GENNY  to  explain  why 
the  expert  system  diagnosed  a  camera  aperture  fault,  .^be  responds: 


The  aperture  component  is  damaged  because  the  light -pictures  observation  and  the 
dark-pictures  observation  indicate  damage.  The  light -pictures  observation  has  a 
likelihood  value  of  six.  The  dark-pictures  observation  has  a  likelihood  value  of 
eight  - 

Figure  1.1  illustrates  the  knowledge  and  processes  engaged  during  generation.  Language  input  is  simu¬ 
lated  by  a  menu  which  offers  the  user  a  choice  of  a  discourse  goal  (define,  explain,  or  compare)  and  then  asks 
for  a  specific  frame  in  the  knowledge  base  which  serves  as  the  discourse  topic.  ®  GENNY  first  formulates  a 
u’.sconrse  plan  based  on  the  given  discourse  goal.  Next  a  relevant  pool  of  rhetorical  propositions  is  generated 
using  the  provided  discourse  topic.  GENNY  then  instantiates  the  plan  -  a  model  of  common  strategies  of 
text  organisation  -  by  choosing  from  among  pertinent  messages  on  the  basis  of  pragmatic  constraints  of 
attentional  focus.  The  subsequent  list  of  rhetorical  propositions  (sequenced  and  connected  via  their  linguis¬ 
tic  role  in  the  discourse)  are  translated  using  case  semantics  into  a  relational  represent ntion  (i  e  *(uhjerf 
object)  and  then  realised  by  a  feature-based  unification  grammar  and  dictionary.  Surface  choice  is  guided 
by  knowledge  of  focus  (past,  current,  and  future)  and  discourse  context  (given/new).  Subsequent  chapters 
illustrate  the  system  components  in  greater  detail  (section  3.3  contain.s  a  theoretical  overview). 


^  kelatlve  importuic*  Ttltt*  is  the  expert  system  representation  of  the  significance  of  «  piece  of  knowledge  at  some  node 
in  a  generalisation  hierarchy  with  respect  to  its  siblings. 

^  The  knowledge  base  is  the  actual  output  from  an  expert  system  run. 

^  Actual  interprelaiioi;  o'  the  discourse  goalfs)  smd  topiefs)  from  natural  language  involves  non-trivial  issues,  but  was 
beyond  the  scope  of  this  project. 
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1.2  Motivations 

NLG  is  a  ftuitful  field  of  endeavour  both  due  to  a  recent  pragmatic^  need  for  generation  capabilities 
together  with  the  theoretical  insight  offered  by  examining  language  from  a  non-traditional  perspective:  the 
producer.  From  a  computational  viewpoint,  computet  systems  are  increasingly  dependent  upon  fiexible 
natural  language  interfaces  which  accurately  reflect  the  state  of  the  underlying  representation-  This  need  is 
particularly  acute  in  applications  requiring  explanatory  capabilities  such  as  expert  systems  or  complex  data 
bases  [Malhotra.  1975]. 

A  specific  expert  system,  developed  previously  by  the  author  (Maybury,  1986),  provided  direct  impetus 
for  a  generation  front-end.  The  central  requirement  was  for  a  NLG  system  which  could  both  educate  a 
user  about  the  contents  of  the  knowledge  base  as  well  as  communicate  the  reasoning  behind  a  particular 
diagnosis.  This  is  discussed  more  thoroughly  in  subsequent  sections. 

On  the  other  hand,  the  theoretical  aspects  of  how  speakers  identify,  package  and  present  information, 
involve  equally  non-trivial  issues.  The  often  ill-motivated  linguistic  components  of  current  NLG  systems 
suggest  a  need  to  attempt  a  mote  universal  framework  for  production  This  inadequacy  manifests  itself  in  a 
rough  and  commonly  “hard- wired"  transition  from  the  planning  to  the  realisation  stages,  1  propose  to  utilise 
relational  grammar  [Perlmulter,  1979,  1980.  1984].  to  bridge  the  gap  b^wcen  surface  syntax  and  deep  case 
semantics. 

Moreover,  it  is  the  author's  belief  that  attempts  to  develop  a  more  coherent  framework  for  production 
should  offer  insight  into  the  interpretation  process.  While  it  w'ould  be  oversimplifying  to  suggest  that  gen¬ 
eration  isomorphtcally  mirrors  interpretation,  it  is  certainly  arguable  from  a  cognitive  efficiency  perspective 

^  The  term  pragmatic  it  uted  throughout  thit  ditsertation  in  reference  to  two  dittinct  ideat  depending  upon  context.  Here 
it  it  uted  to  mean  practical  or  empirical  whereat  elsewhere  it  it  alto  uted  to  refer  to  the  level  of  language  which  dctcribes 
such  phenomena  as  intention,  belief,  focus,  etc.  See  Chapter  6  for  •  more  detailed  discussion. 
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that  humans  exploit  nonredundant  linguistic  knowledge  structures  (Golden,  1985].  *  In  this  spirit,  knowledge 
formalisms  representing  linguistic  competence®  (e.g.  grammar  and  dictionary)  used  previously  for  interpre¬ 
tive  purposes  [Maybury,  1987]  are  here  exploited  for  generative  tasks.  Hence  the  grammar  and  dictionary 
formalism  in  GENNY  can  be  considered  bi-directional.  The  bi-directionality  of  the  higher  level  text  schema 
remains  to  be  investigated. 

1.3  Goals 

The  central  aim  of  the  project  was  two-fold.  The  first  goal  was  to  develop  a  consistent  theory  of  the 
generation  process.  This  involved  several  major  subtasks  including:  development  of  a  domain-independent 
model  of  discourse  structure  based  on  analysis  of  natural  texts;  the  identification  and  formulation  of  a 
(limited)  set  of  pragmatic  constraints  on  the  generation  process;  and  an  attempt  at  a  language-independent 
linguistic  representation. 

The  second  goal  was  to  implement  a  computational  model  of  the  text  generation  process  defined  above 
to  test  these  ideas  concretely.  Again,  several  main  subtasks  were  involved  including:  analysis  of  natural  texts 
and  extraction  of  text  schemata  and  their  corresponding  rhetorical  predicates;  design  of  a  system  motivated 
by  the  desire  for  domain  and  language  independency,  semantic  connection  of  the  generation  system  to  the 
knowledge  base  (KB)  formalism;  implementation  of  algorithms  constituting  focus  of  attention;  development 
of  a  unification  grammar  with  features;  coding  of  morphological  and  orthographic  synth.  ^is  routines;  and 
building  of  a  lexical  access  system  and  a  domain  dictionary. 

All  of  these  initial  theoretical  and  practical  goals  were  met.  Furthermore,  an  additional  domain  of 
discourse  (photography)  was  investigated  to  illustrate  GENNY's  domain  independency.  Future  goals  of 
NLG  research,  particularly  in  the  difficult  areas  of  pragmatics  and  user  modelling,  were  indicated. 

1.4  Dissertation  Organisation 

The  typical  dissertation  is  organised  along  the  lines  of  a  theoretical  discussion  first,  followed  by  a 
description  of  the  systen.  implementation,  In  contrast,  this  work  develops  both  theory  and  implementation  in 
tandem.  This  maximises  the  connection  between  the  linguistic  principles  investigated  and  their  realisation  in 
GENNY.  Each  section  commences  with  a  discussion  of  theory  and  background  work,  followed  by  a  description 
of  Vow  these  issues  were  addressed  in  GENNY.  But  in  order  to  enhance  readability,  an  overview  of  the 
linguistic  approach  (and  thus  dissertation  organisation)  is  presented  immediately  following  the  discussion  of 
current  research  in  NLG  in  the  next  chapter. 


It  mfty  even  be  the  case  that  some  procedural  components  are  shared. 

This  can  be  contrasted  with  the  ability  to  generate  linguistic  forms:  performance. 
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Chapter  2 


TEXT  GENERATION  LITERATURE 


Not  everything  is  unsayable  in  words,  only  ike  living  truth. 


lot  ' SCO 


2.1  Introduction 

This  chapter  places  GENNY  in  the  context  of  past  and  current  attempts  at  NLG.  First,  early  approaches 
to  generate  are  reviewed.  Following  this  is  a  detail  of  recent  research  which  has  focused  on  the  central 
questions  of  generation:  how^  what,  and  when  to  utter.  The  chapter  concludes  by  introducing  the  more 
subtle  question  of  why  we  say  something  and  suggests  what  we  should  do  now. 

2.2  Initial  strategies 

Initial  attempts  to  generate  language  centered  around  single  utterances  in  isolated  context.  At  first 
messages  were  typed  in,  providing  canned  text  as  good  as  the  human  could  compose.  Not  only  does  this  lack 
flexibility,  but  the  implementor  must  anticipate  every  necessary  message  and  situation.  This  will  be  feasible 
only  in  the  most  trivial  of  applications.  More  crucially,  if  the  underlying  system  is  altered  and  the  canned 
text  remains  unchanged,  the  actual  performance  of  the  system  can  be  far  from  that  which  the  system's 
messages  suggest.  Programmers  tend  to  compensate  for  this  by  writing  general  and,  oftentimes,  misleading 
messages  (Bossie  and  Mani,  1986]. 

Terry  Winograd  [1972]  achieved  a  significant  improvement  upon  canned  text  in  his  blocks  world  system 
(SHRDLU)  by  employing  the  code  conversion  technique.  As  the  phrase  implies,  each  entity  in  the  underlying 
knowledge  representation  is  associated  with  a  surface  text  expression.  These  associations  are  manipulated 
with  clever  heuristics,  to  map  the  knowledge  representation  onto  English  text.  A  similar  direct  translation 
of  the  underlying  formal  representation  was  used  by  Simmons  and  Slocum  [1972  from  McKeown,  198.5).  who 
grew  sentences  from  verb  case  semantic  networks  using  ATN  grammars  [Augmented  Transition  Networks 
from  Woods,  1970). 

Early  approaches  were  greatly  extended  by  Goldman's  [J975]  system,  MARGIE,  which  answered  <iues- 
tions  about,  made  inference  from,  and  paraphrased  conceptual  dependency  (CD)  networks  [Schank,  1975]. 
Although  he  also  used  ATN’s  to  generate  syntactic  structures,  he  developed  procedures  for  lexical  choice. 
While  Goldman  did  not  linguistically  justify  his  paraphrase  choices  or  demonstrate  contextual  influence  in 
multi-sentential  output,  his  dictionary  formulation  influenced  many  subsequent  generation  systems. 
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These  mitial  approaches  solved  some  of  the  consistency  problems  of  canned  text  since  output  is  a  product 
of  the  knowledge  base.  *  Nevertheless,  complex  messages  which  require  interaction  of  several  entities  in  the 
knowledge  base  together  with  application-motivated  heuristics  can  lead  to  confusing  if  not  misleading  text 
[Bossie  and  Mani,  1986]. 

In  fact  attempts  at  multi-utterance  generation  revealed  the  requirement  of  a  distinct  linguistically  rep* 
resentation.  This  became  clear  to  Meehan  [1979],  who  generated  stories  of  goals  and  frustrations  in  his 
system  TALB^SPIN,  as  well  as  Swartout  [1981],  who  produced  explanations  from  a  medical  consultation 
system.  Both  found  that  underlying  knowledge  formalisms  were  ill-suited  for  linguistic  tasks,  particularly 
when  translating  long  chains  of  inference  [c.f.  McDonald,  1983].  Kukich  [1986]  in  her  system,  XSEL,  which 
helps  the  user  produce  purchase  orders  for  computer  systems,  suggested  that  messages  should  be  generated 
independent  from  the  underlying  knowledge  and  inference  mechanisms. 

These  representational  issues  were  stimulated  by  a  need  for  a  deeper  linguistic  representation  to  deal 
with  longer  texts  and  the  problems  they  entail.  A  computational  model  for  text  generation  must  incorporate 
mechanisms  sophisticated  enough  to  manipulate  both  linguistic  and  general  knowledge  to  resolve  the  issues 
of  how  io  say  something^  when  to  say  it,  and  what  to  say. 

2.3  How  to  Say  Something 

If  longer  texts  are  to  be  treated  properly,  their  constituents  ~  rhetorical  predicates  -  must  be  realised  in 
a  well  motivated  fashion.  These  (ideally)  domain  independent  messages  must  be  mapped  onto  surface  form 
with  the  aid  of  grammars,  lexicons,  and  perhaps  user  models. 

McDonald's  [1981abJ  MUMBLE  generator  investigated  message  formalisms  in  a  variety  of  knowledge 
representations,  including  predicate  calculus,  FRL  (Frame-oriented  Representation  Language)  [Goldstein 
and  Roberts,  1977  in  McDonald,  1981b]  and  KL-ONE,  which  consists  of  highly-structured  semantic  networks 
[BBN,  1978].  This  ‘input-driven”  generator  is  sensitive  to  the  previous  discourse,  previous  decisions,  as  well 
as  a  user  model  of  audience  knowledge. 

MUMBLE  transforms  this  message  using  “two  cascaded  transducers  folded  together  under  the  command 
of  a  single,  data-directed  controller”  [McDonald,  1981,  p.  21]  (see  figure  2.1).  The  first  transducer  or 
interpreter  expands  the  input  message  into  a  tree  which  represents  the  surface  structure.  Then  the  controller 
traverses  the  tree  depth-first^  and  uses  the  dictionary  to  replace  message  tokens  with  structure  and  lexical 
items.  At  the  same  time,  the  grammar  is  consulted  to  choose  appropriate  syntax  structure.  GENN^’  follows 
McDonald’s  philosophy  of  message-driven  generation  and  syntactic  independence  but  allows  for  pragmatic 
knowledge  (c.g.  focus  and  context)  to  affect  surface  form. 


^  In  faci,  this  approach  is  used  in  commercial  syetems  (XPLAIN,  EMYCIN). 

^  McDonald  invests  a  significant  efibrt  into  the  psycholmguistic  plausibility  of  his  con^utational  mode]  of  spoken,  not 
ivritten,  text.  Thus  the  decision-making  process  proceeds  in  a  left  to  right  manner.  This  aids  efficiency  significantly. 
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r<(ur«  a.i.  LingtiisCk  Component  [from  McDonald,  1981,  p.  21j. 

3.3.1  Grammars 

Related  work  has  focused  on  the  development  of  better  systemic  grammars  [Halliday,  1976ab].  Like 
ATN’s,  *  systemic  grammars  attempt  to  model  a  system  of  choices,  encoding  grammatical  aspects  such 
as  number  and  mood.  They  perform  the  role  of  GENNY't  syntactic  specialists.  Unlike  phrase  structure 
grammars,  systems  are  not  sequentially  accessed,  being  activated  only  when  required.  This  lends  efficiency 
and  clarity.  ^ 

Under  this  formalism,  [Davey,  1979]  examined  commentary  on  a  game  of  tic-tac-toe.  Davey's  system 
had  underlying  concepts  such  as  ‘^counter-attack*  and  *Toi]ed- threat*  and  was  able  to  select  connectives  (e.g. 
“and",  “however",  “but")  based  on  context.  Hence,  communicative  function  could  influence  surface  text,  as 
in  GENNY.  However,  unlike  GENNY,  this  was  done  with  domain  dependent  primitives. 

Mathiesson  [1980]  helped  develop  the  PENMAN  generator  (Mann,  1983],  the  largest  systemic  generator 
to  date.  The  thrust  of  the  research  has  been  on  the  NIGEL  sentence  generator  [Berg  1975,  1977;  Halliday  and 
Tastin,  1981  from  Appelt,  1985],  which  converts  systemic  features  into  syntactic  features  using  realisation 
procedures. 

Simmons  and  Chester  [1982]  generated  sentences  using  bi-directional  grammars  in  PROLOG.  Rule 
systems  which  both  interpret  and  generate  language  manifest  a  desirable  property  of  mental  models:  cognitive 
economy.  GENNY  experiments  with  a  bi-directional  grammar  as  well  as  a  bi-directional  dictionary.  However, 
it  remains  to  be  seen  if  these  non-redundant  mechanisms  can  both  generate  and  analyse  effictently. 

3.3.2  Lexicons 

A  number  of  researchers  recognise  the  need  for  more  powerful  lexical  mechanisms.  Language  entails 
much  more  than  grammar  and  words,  but  linguists  often  avoid  troubling  items  such  as  frosen  phrases  or 
conventional  expressions.  [Becker,  1975]  suggests  incorporating  conventional  phraseology  in  the  lexicon  since 
“utterances  are  composed  by  the  recitation,  modiflcation,  concatenation,  and  interdigitation  of  ptevioudy- 
known  phrases."  Jacobs  [1985]  is  developing  a  formalism  for  representing  a  phrasal  lexicon  which  captures 
both  syntactic  and  semantic  regularities  in  langu^e. 


*  Used,  for  exsnq>lc,  in  the  BABEL  gcnersior  [OeldnisD,  1979]  to  express  parsphroset. 

^  Due  to  the  modularity  of  GENNY,  it  would  iatcrestiaf  to  replace  the  syaiaetic  component  with  a  STStemic  grammar  for 
eompariaon. 
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2.4  When  to  Say  it 

While  the  work  McDonald  and  others  pursue  emphasises  lexical  and  grammatical  issues,  other  research 
has  focused  on  the  planning  involved  in  text  production.  Cohen  |1978]  worked  on  planning  speech  acts  (e.g. 
inform,  request)  in  response  to  a  user  query.  While  his  system,  OSCAR,  did  not  generate  English  output, 
it  did  select  an  appropriate  speech  act,  determined  which  agents  were  involved  and  chose  the  propositional 
content  of  the  speech  act.  * 

Appelt  [1985]  extended  Cohen's  suggestions  by  applying  artihcial  intelligence  planning  techniques  not 
only  to  speech  acts  but  also  to  decisions  involving  syntactic  structure  and  lexica]  choice.  Like  Cohen,  Appelt 
viewed  speech  acts  as  communicative  goals  which  could  be  modelled  by  planning  processes.  In  general,  he 
saw  goal  satisfaction  as  a  complex  interaction  between  physical  and  linguistic  actions,  ultimately  motivated 
by  the  speaker’s  desires.  Appelt  implemented  his  ideas  in  KAMP  (Knowledge  And  Modalities  Planner), 
a  hierarchical  planner  with  multiple  levels  of  representation  including:  illocutionary  acts  (request,  inform), 
surface  speech  acts  (abstract  representations  of  the  knowledge),  conceptual  activation  (description  selection), 
and  utterance  acts  (surface  choice).  ^ 

We  can  distinguish  between  the  generation  approaches  of  Appelt  and  McDonald  as  wholly  pre-planned 
versus  interleaved  planning  and  realisation,  respectively.  Appelt's  system  worked  since  he  took  into  account 
the  hearer's  knowledge  and  state  and  only  a  limited  pragmatics  scope.  Hence,  the  constrained  search  space 
made  backup  computationally  feasible.  In  contrast,  McDonald  employed  limited- commitment  planning^ 
allowing  for  two  way  communication  between  his  planner  and  realiser.  GENNY  recognises  the  need  for 
flexible  planning  and  allows  informational  dearth  to  signal  to  the  text  planner  to  select  another  message  to 
realise.  GENNY’s  weakness  is  that  failure  to  realise  a  message  will  not  signal  to  the  planner  to  choose  an 
alternate  strategy.  Future  generators  must  interleave  content  selection,  planning,  and  realisation  in  a  more 
flexible  manner. 

2.5  What  to  Say 

Just  as  a  generator  must  decide  how  and  when  to  say  something,  it  also  must  determine  what  to  say 
which  concerns  issues  of  ordering,  grouping,  and  focusing.  Initial  research  in  this  area  [Mann  and  Moore, 
1981]  was  essentially  bottom-up.  Mann  and  Moore's  partitioning  paradigm  involves  traversing  the  underlying 
knowledge  structure  depth-first  to  obtain  groufnng  of  propositions.  While  consistent  for  small  texts,  this 
method  fails  to  embody  the  flexibility  necessary  to  produce  longer  texts.  The  fragment-and-compose  paradigm 
[Mann  and  Moore,  1981]  does  provide  variability.  First  the  message  is  divided  into  elementary  propositions. 
Next,  these  are  ordered  using  rules  of  aggregation  (e.g.  chronology).  The  resulting  possible  orderings  are 
evaluated  by  means  of  preference  values  and  the  best  organisation  is  selected. 

In  contrast  to  these  bottom-up  approaches,  the  teri  structure  view  can  be  characterised  as  essentially  top- 
down.  Weiner  [1980]  began  work  on  this  paradigm  by  developing  an  explanation  grammar  which  formalises 
the  ordering  of  propositions  and  characterises  text  structure.  Furthermore,  focus  of  the  text  is  controlled  by 
a  pointer  to  propositions  throughout  the  explanation. 

^  Recently,  Cohen  (1981]  proposed  •  plonning  system  which  determines  referential  descriptions. 

^  The  KAMP  mechanism  was  based  on  procf^aral  nets  (Sacerdoti  1977]  which  allow  knowledge  from  many  different  sources 

to  interact  to  solve  a  problem. 


8 


A  HtporX  Generator 


requests  deff&Ulons 

identificatiofi 

constituency 

requests  for  nvnll^le  Informntton 

attributive 

constituency 

requests  about  the  difference  between  objects 
compare  and  contrast 

fifur*  3.3.  TEXT  schema  [from  McKeown,  1985,  p.  41]. 

Weiner  proposed  that  a  siateiiieni  can  be  jusiilied  by  offering  reasons,  supporting  examples,  and  im* 
plausible  alternatives,  except  for  the  statement.  These  justification  techniques  are  realised  in  his  system  by 
four  predicates:  statement,  reason,  example  and  alternative.  Connectives  such  as  and/or  and  if/then 
allow  for  further  complexity  of  predicates.  In  order  to  incorporate  this  complexity  and  yet  retain  consistency 
in  the  surface  level  text,  the  explanation  grammar  rules  generate  trees  which  are  further  altered  by  trans¬ 
formational  rules  to  form  a  hierarchical  structure  representing  the  explanation.  At  this  stage,  nodes  in  the 
tree  (representing  focus)  are  selected  so  as  to  achieve  a  natural  fiow  of  ideas. 

These  ideas  were  expanded  and  improved  upon  by  McKeown  in  her  TEXT  system  [McKeown,  1985).  Her 
system  generates  textual  responses  to  questions  about  the  Office  of  Naval  Research  (ONR)  data  base  on  ships. 
McKeown  identified  three  types  of  user  requests  to  the  ONR  data  base;  requests  for  definitions,  requests  for 
available  information,  and  requests  for  the  difference  between  two  objects.  (In  contrast,  GENNY  answers 
not  only  definitional  and  difference  questions,  but  also  examines  generation  of  diagnostic  explanations.) 

As  in  previous  systems,  McKeown  delineates  the  strategic  (what  to  say)  and  tactical  (how  to  say 
it)  components  of  the  natural  language  generation  problem.  Unlike  previous  systems  which  traced  some 
underlying  knowledge  structure  to  generate  text,  her  system  is  guided  by  descriptive  strategies.  She  allows 
focus  information  provided  by  the  message  from  the  strategic  component  to  influence  syntactic  structure. 

McKeown 's  work  is  based  on  a  formal  theory  of  discourse  strategy  and  focus  of  attention.  She  introduces 
rhetorical  techniques  which  are  in  essence  a  schema  or  a  text  structure  outline  (figure  2.2).  These  aid  in 
selecting  propositions  from  a  relevant  knowledge  pock  a  source  of  pertinent  information  generated  from  the 
knowledge  base.  In  addition,  a  focusing  mechanism  provides  low-level  coherency  by  connecting  current  and 
previous  focuses  of  attention  [Sidner,  1979J.  Her  tactical  component  (Bessie  [1981])  translates  messages  into 
English  uung  a  functional  grammar,  based  on  Kay's  [1979]  formalism. 

McKeown 's  text  generator,  based  on  written  not  spoken  language,  has  no  mechanism  for  self-correction, 
ellipsis,  ongrammaticaliiy,  informal  phraseology,  style,  interruption  or  circularity.  She  has  suggested  that 
a  more  powerful  control  mechanism  could  augment  the  systems  performance.  In  particular,  a  backtracking 
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mechanism  [ala  Appelt,  1985]  would  allow  for  self-correction.  She  has  recently  extended  her  model  to  tailor 
explanations  for  the  user  (McKeown  et  a/.,  1985]  in  an  advisory  system  for  course  selection. 

Just  as  McKeown  examined  generating  descriptions  from  data  bases,  so  Kukich  [1984]  developed  a 
system,  ANA,  which  generates  stock  reports  from  a  knowledge  base  of  daily  trading  on  the  Dow  Jones 
stock  exchange.  While  McKeown  contributed  a  clear  and  well- motivated  theory  of  text  structure  and  focus, 
Kukich  [1984]  developed  algorithms  to  obtain  fluency  in  DB  reports.  She  argues  that  attaining  fluency  is 
difficult  because  it  relies  on  many  different  types  of  knowledge:  semantic,  lexical,  syntactic,  grammatical, 
and  rhetorical.  She  proposed  interaction  between  these  different  knowledge  sources  to  guide  surface  choices. 
Future  text  generators  should  be  guided  not  only  by  discourse  strategies  and  fluency  mechanisms,  but  also 
by  models  of  speaker  and  hearer  intent. 

3.fl  Why  do  we  Say  it? 

We  have  seen  that  generators  must  incorporate  mechanisms  to  determine  how,  when,  and  what  to  say, 
but  more  sophisticated  generators  must  decide  why  to  say  it.  This  will  require  a  wider  range  of  pragmatic 
reasoning  when  producing  utterances.  A  pioneer  system,  ERMA  [Clippinger,  1974],  attempted  to  model 
false  starts,  hesitations,  and  suppressions  by  incorporating  a  series  of  sophisticated  modules.  These  included 
CALVIN  (topic  collection  and  Altering),  MACHIAVELLl  (topic  organisation  and  phraseology),  CICERO 
(realisation),  FREUD  (monitoring  the  origins  of  rhetorical  plans),  and  LEIBNITZ  (a  ‘^concept  definition 
network").  While  some  of  their  functions  clearly  include  issues  addressed  previously,  others  suggest  a  much 
broader  influence  on  text  (e.g.  self  monitoring). 

PAULINE  [Hovy,  1987]  (Planning  and  Uttering  Language  in  Natural  Environments)  can  be  viewed 
as  a  parameterisation  of  ERMA.  PAULINE  characterises  conversational  setting  in  terms  of  conversational 
atmosphere  (the  speaker,  the  hearer,  the  speaker-hearer  relationship)  and  characterises  interpersonal  goals 
of  the  hearer  and  the  speaker-hearer  relationship.  For  example,  in  a  particular  discourse,  the  speaker  is 
represented  in  terms  of  his  knowledge  of  the  topic  (expert,  student,  novice),  interest  in  the  topic  (high, 
normal,  low),  opinions  of  the  topic  (good,  neutral,  bad)  and  emotional  state  (happy,  angry,  calm). 

PAULINE  represents  a  set  of  rhetorical  goats  which  act  as  intermediaries  between  the  pragmatics  of  the 
system  (the  speaker’s  interpersonal  goals  and  conversational  setting)  and  the  syntactic  decisions  (a  phrasal 
lexicon  and  syntactic  experts).  Thus,  one  can  set  the  above  pragmatic  parameters  to  effect  the  rhetorical 
goals,  ultimately  realising  in  stylistic  English.  These  rhetorical  goals  include  formality,  simplicity,  timidity, 
partiality,  detail,  haste,  force  etc.  Formality,  for  example,  can  be  highfalutin,  normal  or  colloquial. 

Hovy  argues  for  this  distinct  level  of  stylistic  representation  since  pragmatic  effect  is  seldom  the  result 
of  a  single  rhetorical  goal  but  often  rather  a  complex  interaction  of  many  (see  discussion  Hovy,  1987,  pp. 
36-38).  Furthermore,  rhetorical  goals  offer  a  practical  (certainly  partial)  attempt  at  the  problem-laden  field 
of  pragmatics.  This  work  indicates  exciting  uncharted  territory  for  further  exploration. 
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2.T  What  do  we  do  now? 

We  have  summarised  the  origins  and  the  current  directions  of  natural  language  generation.  Canned 
text,  while  as  fluent  as  the  composer,  is  adequate  only  for  the  most  basic  of  applications.  Furthermore,  this 
method  fails  to  reflect  system  modiflcations.  While  code  conversion  accounts  for  changes  in  the  underlying 
formal  representation,  longer  texts  introduce  significant  coherency  problems. 

Recent  research  efforts  have  resulted  in  linguistically-motivated  models  from  which  we  can  build  gener¬ 
ation  systems.  Deciding  how  to  say  something  requires  a  mapping  of  a  rhetorical  pattern  onto  surface  text 
and  can  include  phrasal  choice,  lexical  selection,  as  well  as  user  models.  Planning  when  to  say  it  should  be 
guided  by  the  interaction  between  speaker  and  hearer  (it  entails  such  notions  as  speech  acts  and  communica¬ 
tive  goals)  to  help  mould  text  to  be  sensitive  to  the  audience.  Determining  what  to  say  may  be  interleaved 
with  deciding  when  to  say  it  and  wilt  require  Che  use  or  generation  of  rhetorical  patterns  which  reflect  the 
discourse  role  or  function  of  the  text  and  the  type  of  audience.  This  includes  the  issue  of  content,  which 
should  be  guided  by  the  goat  and  topic  of  the  discourse  (taking  into  account  relevancy,  scope  end  cogency). 
Finally,  intelligent  text  generation  systems  of  the  future  must  incorporate  mechanisms  for  selecting  words, 
referents,  and  syntsuc  based  on  a  user  model. 

We  now  need  to  investigate  the  pragmatic  effects  on  surface  form  and  the  employment  of  devices  (lexica), 
structural  and  semantic)  to  enhance  textual  connectivity  and  plausibility.  Combining  the  ideas  detailed  in 
the  next  chapter,  GENNY  examines  the  use  of  some  pragmatic  information  (e.g.  focus,  given/new)  to 
constrain  surface  form. 
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Chapter  3 

FUNCTIONAL  LINGUISTIC  FRAMEWORK 

IVkai  ta  needed  and  what  has  been  lacking,  is  a  cohesive  theory  of  how  humans  understand  natural 
language  without  regard  to  particular  subparts  of  that  problem,  with  regard  to  that  problem  as  a 
whole. 

Roger  Schank 


3.1  Introdaction 

In  [Dik,  1978],  the  fotmai  and  the  functional  linguistic  paradigms  are  contrasted.  The  format  paradigm 
(the  basic  view  underlying  Chomskian  linguistics)  deRnes  a  language  as  a  set  of  sentences  whose  primary 
function  is  the  expression  of  thoughts.  In  contrast,  the  functional  paradigm  defines  language  as  an  instrument 
of  social  interaction,  with  a  primary  purpose  of  communication.  While  the  formal  paradigm  describes 
sentences  independently  of  the  setting  (context  and  situation)  in  which  they  are  used,  Dik's  functional 
paradigm  allows  linguistic  expressions  to  be  molded  by  their  function  within  a  given  setting.  Furthermore, 
while  the  formal  perspective  regards  language  universals  as  innate  properties  of  humans,  the  functional  view 
explains  language  universals  in  terms  of  the  constraints  of  the  goals  of  communication,  the  biology  and 
psychology  of  the  communicators,  as  welt  as  the  setting  of  the  communication.  In  general,  the  relation 
between  pragmatics,  semantics  and  syntax  within  the  formal  paradigm  is  one  of  subservience.  Within  the 
functional  framework,  conversely,  pragmatics  influences  semantics  and  semantics  effects  syntax. 

The  design  of  GENNY  was  guided  by  the  functional  paradigm.  Provided  a  discourse  goal,  GENNY 
employs  knowledge,  discourse,  pragmatic,  semantic,  relational  and  syntactic  constraints  to  generate  natural 
language.  While  the  current  implemented  generation  system  by  no  means  incorporates  the  whole  of  Dik's 
functional  perspective  (e.g.  there  is  no  analysis  of  the  setting  of  the  discourse,  nor  of  the  participants  it 
nevertheless  establishes  a  framework  from  within  which  these  aspects  can  be  investigated. 


^  Although  pretimmary  atudics  in  this  ch«ll«nfing  arcs  of  user  modelling  suggest  that  GENNY  could  natundly  incorporate 
a  naive/expert  diatinetion  when  selecting  relevant  knowledge  as  well  as  when  choosing  grammatical  or  lexical  expressions. 
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rigura  a.i.  Functional  Linguistic  Framework 
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3.2  Recent  Insights 

This  representation  incorporates  several  recent  advances  in  computational  linguistics  (and  is  suggestive 
of  future  extensions).  These  include  (discussed  later  in  detail)  Barbara  Gross's  [1977]  ideas  on  global  focus 
(knowledge  relevancy,  implicitly  focused  entities,  and  focus  shifting),  Candace  Sidner's  [1983]  use  of  local 
focus  in  anaphora  resolution,  David  McDonald's  [1981]  work  on  knowledge  and  message  formalisms,  Douglas 
Appelt's  [1986]  ideas  of  planning  utterances,  and  Kathy  McKeown's  [1985]  rhetorical-predicate  based  dis¬ 
course  model.  Generative  semantics  in  GENNY  are  represented  in  the  case  formalism  [Fillmore,  1968,  1977] 
while  syntax  follows  the  GPSG  [Gaidar,  1982]  approach.  ^  The  theory  of  Relational  Grammar,  [Perlmutter, 
1980],  which  recognis***  n  '^’‘^tinct  level  of  grammatical  ptiiiiitives  (e.g.  subject,  object)  is  used  by  GENNY 
to  bridge  a  recognised  semantico-syhtax  gap.  ^ 

3.3  Theoretical  Overview 

Figure  3.1  illustrates  the  levels  of  representation  incorporated  into  the  GENNY  text  generation  system. 
The  analysts  begins  with  the  knowledge  representation,  followed  by  a  functional  representation  on  successive 
levels:  discourse,  pragmatic,  semantic,  relational,  syntactic  and  surface.  The  knowledge  representation  is  the 
underlying  method  of  organisation  used  in  the  domain  application  (e.g.  frames,  rules).  The  discourse  model 
embodies  text  schemas  consisting  of  rhetorical  primitives  -  basic  building  blocks  of  larger  texts.  Interleaved 
with  the  discourse  model  is  a  pragmatic  representation  incorporating  a  focus  model  together  with  a  context 
mechanism.  A  case-role  semantic  analysis  is  mapped  onto  a  language-independent  relational  representation, 
which  is  then  used  to  build  a  syntactic  tree.  Morphological  and  orthographic  procedures  generate  the  final 
surface  form. 

3.4  System  Overview 

The  generator  mirrors  this  linguistic  approach.  GENNY  begins  a  session  by  printing  (where  X  and  Y 
are  KB  entities): 

GBINT  can  ansver  questions  oi  the  form: 

Vhat  do  you  know  about  X? 

Can  you  explain  T? 

Vhat  is  the  difference  between  X  and  T? 

Next,  GENNY  inputs  a  domain  dictionary  and  knowledge  base,  and  then  queries  for  a  discourse  topic  and 
discourse  goal.  Consider  the  session  to  output  the  first  text  presented  in  Chapter  1  (user  reply  in  capitals): 

^  White  the  cl«iin  of  working  within  s  functionol  paradigm  may  seem  inronsistent  with  the  use  of  a  Chomskian-based 
syntax  representation,  it  should  be  noted  that  the  unification  GPSG  feature  grammar  represents  the  functional  analysis 
of  a  language  at  the  syntactic  level.  Of  course,  this  strata  is  constrained  by  knowledge  inherited  from  higher  levels  (e  g. 
focus  and  discourse  information). 

*  The  difficulty  of  bridging  the  semantico-syntax  gap  is  manifested  by  “hard-wired"  tactical  generation  components. 
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Pl«a«a  enter  the  domain  dictionary  file  name? 

NBUROPSYCHOLOGY.DICT 

What  ie  the  domain  of  dlacouree? 

NEUROPSYCHOLOGY.KB 

What  do  you  vish  to  speak  about? 

BRAIN 

Do  you  vish  to  DEFIVE,  EXPLAIN  or  COMPARE? 

DEFINE 

Foi  reasons  of  simplicity,  the  discourse  topic  provided  by  the  user  is  assumed  to  be  the  explicit  name 
of  a  frame  within  the  knowledge  base.  Practical  generators  must  perform  the  non-trivial  task  of  mapping 
user  query  onto  knowledge  base  entities.  In  GENNY,  a  more  plausible  approach  would  be  to  perform 
semantic  analysis  on  the  given  lexical  item  (c.f.  Sparck  Jones  and  Tait,  1984],  which  then  could  indicate 
a  discourse  topic(s).  This  is  a  non*ttivial  issue  as  frame  selection  will  be  problematic  for  a  KB  whose 
underlying  representation  does  not  parallel  natural  language.  GENNY  exploits  this  simplification  in  order 
to  concentrate  efforts  on  other  compelling  issues  such  as  discourse  structure  and  focus  shift. 

GENNY  uses  the  discourse  topic  to  generate  a  pool  of  related  information  [knowledge  vtsia)  for  possible 
use  during  discourse  formulation.  GENNY  uses  the  discourse  goal  to  select  a  discourse  plan  [theme-scheme) 
which  will  guide  the  overall  structure  of  the  text  and  provide  top-level  cohesion.  Stepping  through  the 
plan,  GENNY  uses  global  focus  constraints  on  relevant  knowledge  together  with  local  focus  constraints  on 
available  propositions  to  select  the  next  message  (rketortcal  predicate)  to  utter.  ^ 

Once  selected,  GENNY  attempts  to  produce  a  message  by  sending  it  first  to  a  semantic  interpreter  which 
maps  entities  onto  semantic  roles  based  on  their  position  in  the  message  formalism.  The  interpreter  also 
exploits  semantic  markers  which  identify  modifiers  (e.g.  location,  function)  which  eventually  become  prepo¬ 
sitional  phrases.  The  rhetorical  predicate  type  suggests  the  action,  the  choice  of  which  may  be  constrained 
by  the  types  of  knowledge  present  in  the  message  formalism  (e.g.  objects,  acts,  or  states). 

Next,  the  relational  module  uses  syntactic  experts  -  constituent  builders  which  utilise  pragmatic  (e.g. 
given/new),  semantic  (e.g.  case-lexical  relations)  and  syntactic  knowledge  (e.g.  phrasal  components)  -  to 
produce  grammatical  parts  such  as  subject,  direct-object,  and  predicate.  Focus  information  suggests  voice 
(active,  passive)  which  is  manifest  in  the  ordering  of  relational  constituents.  It  is  at  this  stage  that  knowledge 
tokens  in  the  message  formalism  are  translated  to  lexical  entries  using  the  dictionary  system.  The  rhetoriced 
role  the  message  plays  in  the  overall  discourse  (e.g.  cause-effect,  illustration)  may  suggest  particular  sentential 
connectives  (“because”,  “for  example”,  “therefore”,  etc.)  which  enhance  low-level  connerlivity.  Finally,  a 
syntax  tree  is  generated  using  a  feature-enhanced  phrase  structure  grammar  and  surface  form  is  provided  hv 
morphological  and  orthographic  routines. 

A  failed  utterance  (at  the  semantic,  relational  or  syntactic  level)  will  result  in  no  output.  Insufficient 
knowledge  results  in  an  attempt  to  fulfill  discourse  goals  by  alternate  predicates  or  other  possible  fori.  A 

^  On  the  whole,  the  generation  process  is  modular  and  serial,  except  for  interleaved  discourse  and  pragmatic  processing.  A 
sueceMfiil  computational  model  should  accoiint  for  the  behaviour  of  humans.  The  practical  advantage  of  a  serial  proeesi 
is  the  computational  simplicity  and  comprehensibility-  One  major  disadvantage,  however,  is  its  psychological  plausibility 
as  a  mental  model.  Psycholinguistic  studies  and  neurophysiological  evidence  indicate  that  the  cerebral  cortex  exploits  its 
highly  parallel  structure  to  solve  problems  concurrently  (Golden,  1985]. 


Mark  T.  Maybury 


psychologically  plausible  enhancement  would  be  to  maintain  a  minimum  amount  of  information  necessary 
to  reply  to  the  user's  request.  Ignorance  should  lead  to  an  apology.  GENNY's  design  would  facilitate 
incorporation  of  such  minimum  informational  constraints  and  remains  an  interesting  area  for  further  research. 

While  this  appears  to  be  a  plausible  model  of  the  generation  process,  its  ultimate  success  will  depend 
on  rigorous  testing  of  all  these  components  for  multiple  domains,  knowledge  formalisms,  languages,  and  text 
types.  (See  chapter  10  for  testing  details.)  The  remainder  of  this  dissertation  illustrates  and  discusses  each 
linguistic  strata  in  turn  including:  knowledge,  discourse,  pragmatics,  semantics,  relations,  and  syntax. 


Chapter  4 


KNOWLEDGE  AND  DOMAIN 


Get  wisdom,  get  understanding 

Proverb*  4,S 


4.1  Domain  of  Discoarae 

Tha  pragmatie  motivation  of  CEN'N'V  tosta  on  a  dvsirr  for  natural  communication  with  a  fault-diagnosis 
expert  system  in  the  domain  of  neuropsychology  (NEUROPSYCHOLOGIST)  (Maybuty  and  Weiss,  1987], 
Neuropsychological  diagnosis  is  an  approach  to  determining  whether  or  not  a  patient  suffers  from  neurological 
disfunction.  A  typical  evaluation  with  a  patient  consists  of  responding  to  verbal  questions  or  performing 
perceptual  or  ntetnoty  tasks  which  illuminate  the  behavioral  condition  of  the  patient.  After  collecting  the 
empirical  data  (standardised  test  scares)  and  subjective  data  (clinical  and  qualitative  observations),  the 
neuropsychologist  attempts  to  match  the  symptoms  with  particular  categories  of  cerebral  disorders. 

In  simulation  of  this  process,  a  typical  session  with  NEUROPSYC'HOLOGIST  would  begin  with  some 
standard  questions  such  as  the  age,  health,  family  history  (e.g.  hereditary  diseases)  etc.  This  would  be 
followed  by  mote  specific  questions  (user  reply  in  caps): 


Hou  quickly  did  tha  condition  appear? 

Please  type  the  sord  UfSTART,  DATS,  NOPTHS-TEARS ,  or  VISVHB: 

INSTANT 

Did  tha  patient  recently  daaage  his  head  in  an  accident? 

NO 

Does  the  patient  suller  from  right  hemisphere  paralysis? 

WHY? 

Knoeladge  about  L-HEHI-PARALTSIS  helps  determine  the  condition 
of  the  LEFT-RENISPHERE .  Values  from  the  RIGHT-FIRGER-TAPPIRG  test 
and  the  FACE-SAGGIRG-WALK-LIRPING  observation  determine  the  value 
of  L'HEHI-PARALTSIS.  LARGUA6E.  COHPREHERSION .  NEGATIVE-HOOD, 
HOVEMENT-IHPAIRMEIfT,  L-COG-FLEAIBILITT,  HENTAL-CONTROL ,  and  WRITING 
also  are  used  to  determine  the  condition  of  the  LEFT-HEMISPHERE. 

Does  the  patient  suffer  from  right  hemisphere  paralysis? 

NO 

What  score  did  tha  patient  receive  on  the  famous  faces  naming  test? 


These  information  gathering  questions  have  the  fluency  and  coherency  of  the  author,  but  requite  hand¬ 
encoding  of  an  appropriate  question  for  each  new  knowledge  entry.  However,  KB  expansion  or  alteration 
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will  not  be  reflected  in  the  user  interface  unless  it  too  is  updated.  Also,  the  template  listing  of  results  often 
results  in  stilted  (possibly  misleading)  output  as  in  the  above  response  to  the  query  WHY  (i.e.  Why  does 
the  patient  suffer  from  r-kemi-paralysis?). 

After  each  response,  the  user  is  asked  how  sure  he  or  she  is  of  the  test  results  or  observation.  This 
encourages  a  subjective  analysis  of  all  empirical  evidence.  Results  of  tests  and  observations  are  combined 
using  Bayesian  [Bayes,  1763]  heuristics  based  on  the  weight  and  value  of  each  piece  of  evidence.  The  user 
may  elect  not  to  answer  a  question  by  simply  replying  UHSURE.  * 

Questions  completed,  the  system  issues  its  diagnosis: 

DIAGNOSIS 

The  patient  has  a  DISORDEk  with  probability  0.8 

DISORDER-TYPE  PROBABILITY 

GLOBAL 
FOCAL 
AMNESIC 

Of  course,  the  user  could  query  for  further  explanation: 

WHY  FOCAL? 

The  patient  has  a  FOCAL  disorder  with  probability  0.8  because: 

DISORDER  PROBABILITY 

FRONTAL  0 . 3 

HEAD-TRAUMA  0.8 

STROKE  0 . 0 

TUMOR  0 . 1 

DEMYELINATION  0.0 

WHY  HEAD-TRAUMA? 

The  patient  has  a  HEAD-TRAUNA  with  probability  0.8  because; 

EVIDENCE  PROBABILITY 

INSTANT-ONSET  1.0 

HINOR-LTN-DAMAGE  0.9 

ACCIDENT  O.S 

WHY  INSTANT-ONSET? 

The  patient  has  INSTANT-ONSET  with  probability  0.8  because 
you  told  me  so. 


0.3 

0.8 

0.0 


^  If  enhanced  with  more  complete  knowledge  and  description*,  the  system  could  be  used  as  an  interactive  tutor. 
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While  the  explanation  facilities  provided  in  NEUROPSYCHOLOGIST^  sufficed  for  the  domain  experts 
(a  neuropsychologist),  other  users  wanted  to  inquire  about  the  structure  of  the  underlying  knowledge  base. 
Requests  of  the  form  Tell  me  about  Alzheimer's  disease  or  Describe  the  brain  were  initial  queries  of  naive  users 
of  the  system  (verbalised  to  the  system  designers).  Furthermore,  the  general  consensus  was  that  explanatory 
diagnostic  lists  were  functional,  but  unnatural. 

The  requirement  for  a  describe  or  define  facility  to  answer  questions  of  the  form  What  is  an  X?  was 
consistent  with  Malhotra's  [1975}  finding  that  naive  data  base  users  often  query  the  general  contents  of  a 
data  base  rather  than  just  specific  values  of  entities  contained  in  that  data  base.  This  mirrors  the  linguistic 
inadequacy  of  listing  long  chains  of  inference  to  explain  reasoning  in  complex  programs  (e.g.  planning 
programs  [Schank  and  Abelson,  1977]).  This  method  encourages  ambiguity  by  relying  on  the  user  to  impose 
conceptual  relationships  between  the  listed  objects. 

4.2  Explanation 

Explanation  includes  the  major  enterprise  of  collecting  and  presenting  linguistically  sufficient  statistics 
and  information.  To  begin,  this  task  involves  the  questions:  Hoxv  does  the  underlying  KR  affect  the  type  and 
extent  of  additional  information  to  be  collected?  and  What  mechanisms  are  necessary  to  collect  and  represent 
this  information  during  system  runs? 

OENNY,  for  example,  instantiates  the  frame  based  model  during  the  run  of  the  expert  system.  Damage, 
test,  or  observation  values  are  stored  in  slots  associated  with  the  appropriate  frame  in  the  brain  and  disorder 
knowledge  base.  In  other  systems  -  rule  based  expert  systems,  for  example  -  appropriate  knowledge  gathering 
mechanisms  would  have  to  be  developed.  The  extent  of  this  task  lies  largely  on  the  scope  of  the  explanation. 
Schank  ei  ai  [1984ab,  1985]  suggest  that  explanation  can  occur  on  a  continuum: 

making  sense  - ^cognitive  understanding  - - - complete  empathy 

Current  artificial  intelligence  technology  deals  with  the  lower  end  type  of  explicit  explanation.  A  more 
interesting  task  (fat  beyond  the  scope  of  this  dissertation)  is  the  explanation  of  anomalous  situations  which 
are  key  to  learning.  [Kass  and  Leake,  1987]  offer  a  categorisation  of  explanation  for  intentional  actions, 
material  anom^ies  and  social  anomalies.  Explanation  raises  issues  on  the  frontiers  of  knowledge  and  language 
and,  ultimately,  may  prove  to  be  the  most  interesting  (and  difficult!)  task  for  generators  of  the  future. 


^  Th«8«  included  the  use  of  the  keyword#  why  and  how  followed  by  an  entity  in  the  knowledge  base  -  a  functional  notation 
representing  the  interrogative  Why  dots  Ihr  patitnt  hart  Alzheimtr't  dtsrast?  in  its  elliptical  form  vAy  alzhetmer#.  Ellipsis 
in  the  functional  notation  occurs  in  the  subject  and  the  type  of  entity  in  the  object.  There  was  also  direct  inquiry  of  a 
specifle  entity  of  the  brain  model  (e  g.  how^bad  left^frontal)  as  well  as  a  why-usefbt  function  for  explanation,  tutoring, 
or  system  debugging. 
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4.3  Dutingmshing  Descriptive  Attributes 

Unfortunately,  current  knowledge  representations  (KR)  are  generally  ill-suited  for  even  the  simplest  of 
linguistic  tasks,  much  less  sophisticated  explanations.  Because  of  the  hierarchicat  structure  of  the  domain, 
frames  [Minsky,  1975]  were  the  natural  method  of  encoding  expert  knowledge  in  the  original  knowledge  based 
system.  Figure  4.1  illustrates  a  typical  frame  characterising  neurophysiology  as  it  appeared  in  the  original 
knowledge  base  after  diagnosis. 


(BRtllt  (SDPER-CLISS 

(VALOE  RBHAR)) 

(SOB-CLISS 

(VALUE  LEFT-HEMISPHERE  RIGHT-HEMISPHERE)) 

(TTPE 

(VALUE  ORGAD) 

(IMPORTINCE 

(VALUE  10)) 

(DAMAGE 

(VALUE  6))) 

Figure  4.1.  Top-level  NBUROPSYCHOLOGIST  frame 


A  frame-based  representation  is  convenient,  efficient  and  powerful.  Frames  consist  of  frame  names,  slots, 
facets,  and  values.  In  figure  4.1  the  parentheses  separate  the  different  categories.  The  frame  name  is  BRAIN. 
The  different  slots  are  SUPER-CLASS,  SUB-CLASS,  TYPE.  IMPORTANCE,  and  DAMAGE.  The  facets 
of  the  slots  in  this  example  are  all  VALUE.  An  alternate  facet  name,  for  example,  is  DEFAULT.  The  actual 
values  ate  the  symbols  which  appear  after  the  word  VALUE  in  each  line.  The  frame  hierarchy  is  defined 
by  the  values  in  the  SUPER-CLASS  and  SUB-CLASS  slots.  Frames  which  are  instantiations  of  a  particular 
frame  TYPE  inherit  properties  of  their  general  frame.  Importance  is  the  relative  significance  of  a  piece  of 
knowledge  with  respect  to  its  siblings  in  the  knowledge  hierarchy. 

Figure  4.2  illustrates  the  same  frame  as  it  appears  in  OENNY.  ^  Note  the  extra  slot  name  DDA  for 
distinguishing  descriptive  attribute  [McKeown,  1985).  This  is  the  only  addition  to  the  KB  for  generative 
purposes.  The  DDA  (attribute- value  pairs)  is  an  additional  slot  in  the  frame  which  describes  the  justification 
for  a  hierarchy  partition  at  this  level  (related  to  (Lee  and  Gerritsen,  1978]  partition-attributes).  In  figure  4.2 
the  brain  frame  can  be  linguistically  distinguished  from  other  parts  of  the  body  (e.g  heart,  lungs)  by  noting 
that  its  primary  function  is  understanding  and  that  it  is  located  in  the  human  skull.  The  DDAs  in  GENNY 
are  more  flexible  than  those  in  TEXT  [McKeown,  1985]  as  they  permit  lists  of  values  to  be  assigned  to  a 
particular  attribute,  much  as  frames  allow  lists  of  v^ues  for  a  particular  slot  name. 


(brain  (super-class  (value  human)) 

(sub-class  (value  left-hemisphere  right-hemisphere)) 

(t3rpe  (value  organ)) 

(dda  (value  (location  skull  human)  (function  understanding))) 

(importance  (value  10)) 

(damage  (value  5))) 


Figure  4.3  IIJostr«tirtn  of  GENNY  frome 


The  knowledge  base  was  augmented  by  three  DDA  attribute  types:  function,  location  and  instru¬ 
ment.  Of  course  these  are  only  three  alternatives  from  a  large  number  of  semantic  markers  which  could 

^  Do  to  the  large  sise  of  the  KB,  only  representative  frames  (37  from  142)  were  actually  used  for  generation  purposes.  They 
were  carefully  chosen  to  reflect  the  full  range  of  knowledge  and  relationships  in  the  original  expert  system. 
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be  used  to  discriminate  entities  [Sparck  Jones  and  Boguiaev,  19B7J.  In  fact,  subsequent  experimentation 
with  a  second  knowledge  base  (photography),  indicated  a  need  for  a  fourth  attribute,  external^location, 
in  contrast  to  a  membership  or  internal  location.  These  attributes  were  used  by  the  semantic  interpreter  to 
assign  proper  roles  to  their  values  in  the  deep  case  structure.  According  to  their  analysis,  these  attributes 
eventually  translate  to  surface  modifiers.  Thus,  external-location  might  realise  as  “on**  whereas  location  as 
**in”,  function  as  ^for”,  and  instrument  as  ‘‘with**.  The  value  of  the  attribute  eventually  translates  to  a  noun 
phrase. 

4.4  Discussion:  Linguistic  and  Extra-linguistic  Knowledge 

The  fact  that  the  DDA  is  the  only  addition  to  the  KB  suggests  the  suitability  of  a  frame  representation 
for  generation  purposes.  This  claim  is  supported  by  experiments  with  a  second,  photographic  KB  and  lexicon 
demonstrating  domain  independence.  Consider  a  typical  output,  in  response  to  the  simulated  query  }Vkat 
ts  photography?: 

Photography  is  an  art-form  for  recording  images  on  film.  It  has  a  relative  impor¬ 
tance  value  of  ten.  It  contains  three  faults:  an  equipment  fault,  a  technique  fault 
and  a  style  fault.  The  equipment  fault  has  a  relative  importance  value  of  three. 

The  technique  fault  has  a  relative  importance  value  of  four.  The  style  fault  has  a 
relative  importance  value  of  nine.  It,  for  example,  is  a  fault  with  personal  expres¬ 
sion. 

It  is  fair  to  compare  GENNY  to  the  TEXT  system  (McKeown,  1985),  which  produced  similar  quality 
text  for  equivalent  definitional  discourse  goals  (although  GENNY  also  investigated  explanations).  (See 
Chapter  10  for  a  comparison.)  However,  in  addition  to  DDAs,  McKeown  found  the  need  to  augment  her 
underlying  KR  (an  entity-relationship  DB  model  [Chen,  1976])  with  both  a  gen€rali$ation  hierarchy  and  a 
topic  hierarchy. 

Under  closer  scrutiny,  we  find  that  the  generalisation  hierarchy  describes  relations  of  entities  (e.g.  part- 
whole)  whilst  the  topic  hierarchy  describes  relations  of  attributes  (e.g.  type-instantiation).  These  additional 
knowledge  structures  would,  unfortunately,  have  to  be  hand-encoded  for  each  new  formalism.  While  this 
application  dependence  is  undesirable,  it  appears  that  there  is  a  certain  amount  of  additional  linguistic  or 
real-wotld  knowledge  (e.g.  DDAs)  which  unavoidably  will  have  to  be  tailor-made  for  each  KR. 

The  frame  paradigm,  however,  minimises  customisation.  This  becomes  clear  when  we  notice  that  two 
types  of  relationships  are  being  encoded  in  these  formalisms:  part-whole  and  type-specialisation  (also  referred 
to  as  a-kind-of).  In  the  frame  KB,  the  slots  named  super-class  and  sub-class  represent  the  part-whole 
relationship  (classes  and  elements,  parts  and  components  or  events  and  sub-events).  The  slot  named  type 
represents  the  type-specialisation  relationship  (object/entity-types  and  ii.stsntiations).  For  example,  the 
frame  in  figure  4.2  encodes  that  a  brain  is  a  part  of  the  human  body  via  the  super-class  slot  and  t  hat  the 
brain  is  a  particular  type  of  organ  via  the  type  slot.  This  example  demonstrates  the  clarity  of  the  frame 
KR. 

This  raises  the  question  as  to  what  is  the  most  effective  KR  from  both  knowledge  and  linguistic  perspec¬ 
tives?  As  outlined  in  section  2.3,  McDonald  [1981]  investigated  a  variety  of  KR  in  his  text  generation  system, 
MUMBLE,  including  predicate  calculus,  PLANNER-style  [Winograd  1972]  data  base  assertions,  OWL,  FRL 
and  KL-ONE.  His  research  suggests  that  different  linguistic  phenomena  are  more  naturally  represented  in 
some  message  formalisms  rather  than  others.  OWL  [Hawkinson  1975  in  McDonsJd,  1981],  for  example, 
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specifically  allows  codificaiion  of  NL  phenomena  (ambiguity,  quantification,  etc).  However,  one  still  has 
the  problem  of  interfacing  this  to  the  uadertying  application  KR.  His  contribution  is  a  message  formalism 
independent  of  the  underlying  representation. 

Unhappily,  current  knowledge  formalisms  ate  inadequate.  Frames  [Minsky,  1975]  as  well  as  scripts 
[Schank  and  Abelson,  1977]  are  difficult  to  select  in  a  well-motivated  manner.  (GENNY  avoids  this  problem 
by  having  the  user  select  a  frame  or  frames.)  Furthermore,  they  deal  poorly  with  non-standard  objects  or 
events.  Scenarios  [Sanford  and  Garrod,  1981],  which  describe  the  **extended  domain  of  reference^,  suffer 
similar  problems  with  control  of  inference.  iohnson-Laird  [1983]  describes  knowledge  in  terms  of  a  model- 
theoretic  semantics  of  possible  states  of  affairs  in  time  and  in  space:  mental  models.  The  practical  details 
of  such  a  representation,  however,  remain  elusive,  and  make  assessment  virtually  impossible.  Nevertheless, 
it  appears  suspect  to  the  same  problems  as  above.  All  KR  have  difficulty  selecting  relevant  knowledge  - 
a  problem  partially  addressed  by  global  focus  algorithms  in  GENNY  (see  section  6.2)  but  which  requires 
further  investigation. 

One  solution  to  these  formalism  deficiencies  is  to  maintain  two  levels  of  representation  for  discourse; 
a  superficial  propositional  format  similar  to  linguistic  form  coupled  with  a  mental  model  representing  the 
structure  of  events  or  knowledge  in  the  teal  world  [Johnson-Laird,  1983]^.  GENNY  can  be  viewed  is  this 
light  since  the  frame  KB  models  the  domain  as  it  exists  structurally  and  functionally  in  nature  (a  sort 
of  **static  mental  modeP)  while  the  rhetorical  predicate  level,  is  more  closely  aligned  with  linguistic  form. 
A  predicate  semantics  connects  the  mental  level  to  the  propositional  level,  which  serves  as  the  basis  for 
discourse  representation  to  which  we  now  turn. 


Psycholofistt  believe  that  eemantic  (long  tenn)  memory  in  humans  plays  a  dual  role:  representing  the  current  state  of 
our  past  experience  of  the  world  and  forming  the  basis  of  linguistic  acts  [Greene,  197S:  132] 


Chapter  5 


DISCOURSE  THEORY 


If  a  ^uejtion  can  he  put  at  all,  then  li  can  aUo  be  answered. 
Ludwig  Wittgenctein 


5.1  Introdnction 

Given  that  hnmans  have  some  mechanism  for  storing  knowledge  (say  in  a  frame-like  representation), 
how  is  it  that  we  ate  able  to  communicate  effectively  in  response  to  a  request  for  information?  Humans 
appear  to  exploit  standard  strategies  to  organise  and  present  ideas.  In  this  chapter,  we  first  examine  what 
properties  make  a  string  of  sentences  a  coherent,  plausible  and  connected  text.  Next  we  examine  the  issues 
of  text  structure  including  story  grammars,  text  grammars  and  text  schema.  GEN  NY's  higher  level  text 
formalism  is  then  presented:  iheme’schemes.  This  chapter  concludes  by  discussing  rkcforica/  predicates,  the 
basic  primitives  of  text  structure. 

5.2  Text 

We  first  distinguish  between  written  and  spoken  discourse  as  representing  a  divergence  in  functional 
emphasis:  the  former  is  predominantly  transactional  while  the  latter  is  mainly  interactional.  To  constrain 
our  task,  we  choose  to  focus  on  written  text  since  spoken  discourse  contains  many  interesting  but  difficult 
phenomena  such  as  phonological  idiosyncrasies  and  speech  errors  (e.g.  slips  of  the  tongue).  ^  The  Concise 
Oxford  English  Dictionary  defines  Hext'  as; 

1.  original  vorda  of  author  as  opposed  to  a  paraplirase  or  commentary  on  them. 

2.  a  passage  of  scripture  quoted  as  authority  especially  as  chosen  as  subject  of 
sermon  etc;  subject,  theme. 

More  suggestive  is  the  definition  of  'texture': 

arrangement  of  threads  etc  in  textile  fabric,  characteristic  feel  to  this;  arrange¬ 
ment  of  small  constituent  parts,  perceived  structure:  representation  of  structure  and 
detail  of  objects  in  art;  quality  of  sound  formed  by  combining  parts. 

Perhaps  this  characterisation  led  Hallidsy  and  Hasan  {197<i.  p.  2)  to  state  that  “a  text  has  texture  and  this 
is  what  distinguishes  it  from  something  that  is  not  a  text  . . .  the  texture  is  provided  by  the  cohesive  rela¬ 
tion."  This  connective  relationship  manifests  itself  in  text  when  interpretation  of  an  utterance  presupposes 
knowledge  of  a  previous  utterance.  For  example,  a  cohesive  relation  can  exists  as  an  anaphot: 

^  We  thu*  explicitly  exclude  such  etfccts  m  phonology,  intonation ,  dialect ,  and  accent ,  and  implicitly  avoid  phenomena  such 
as  spatial  context  (e.g.  body  gestures). 
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Never  hold  onto  ike  punt  pole  tf  tt  pets  stuck  tn  the  mud 

where  the  pronoun  ’Hi*'  refers  to  the  preceding  definite  noun  phrase  “the  punt  pole.^  In  addition,  discourse 
can  be  connected  with  cataphora  (forward  reference)  and  etophora  (extra-textual  reference).  Utterances  can 
also  be  unified  through  formal  markers  such  as  “and**,  “however",  “for  example",  and  “then": 

If  you  fall  tn  the  ritfer  then  you  will  catch  cam  fever. 

Several  grammarians  have  classified  connectives  [Quirk  and  Greenbaum,  1973;  Halliday  and  Hasan, 
1976].  Halliday  [1985,  p.  302*307]  offers  a  taxonomy  of  such  markers:  elaboration,  extension,  enhancement. 
Extension,  for  example,  can  be  additive  (and,  also,  moreover,  in  addition),  adversative  (but,  yet,  on  the 
other  hand,  however)  variation  (on  the  contrary,  apart  from  that,  alternately).  He  relates  surface  forms 
with  these  connectives,  illustrating  their  cohesive  function  in  discourse. 

Clearly  connective  relation  of  text  can  be  implied  rather  than  explicit,  such  as  in  poetry  [Johnson- Laird, 
1983,  p.  377]: 

Swiftly  the  years,  beyond  recall 

Solemn  the  stillne^  of  this  spring  morning. 

Connection  is  also  implied  in  a  list  of  historically  significant  dates  or  -  as  in  the  original  explanation  procedure 
in  NEUROPSYCHOLOGIST  -  as  a  list  of  possible  disorder  candidates. 

Johnson*Laitd  [1983]  distinguishes  between  the  coherence  and  plausibiliiy  of  discourse.  Analysing  the 
response  time  of  humans  to  a  set  of  psycholinguUtic  experiments  involving  referential  continuity,  Ehrlich  and 
Johnson-Laitd  [1982]  established  coherency  as  a  property  of  discourse.  However,  they  characterise  plausi¬ 
bility  as  reflecting  the  ability  to  place  the  actual  sequence  of  events  into  a  temporal,  causal,  or  intentional 
framework 

Clearly  many  devices  aid  the  cohesion  of  text  including  co-reference,  lexical  relationships  (hyponymy, 
part-whole,  collocability),  structural  relationships  like  clausal  substitution  (e.g.  “so  am  I"),  syntactic  rep¬ 
etition,  consistency  of  tense  and  stylistic  choice  [see  Quirk  and  Greenbaum,  1973,  pp.  284-308].  Halliday 
and  Hasan  [1976,  p.  229]  clmm  that  the  heart  of  cohesiveness  “is  the  underlying  semantic  relation."  Hobbs 
[c.f.  Carter,  1985]  provides  the  noteworthy  distinction  between  coherence,  which  stems  from  the  conceptual 
relevance  of  the  text  content,  and  cohesion,  which  arises  from  textual  linkages. 


A  Rtp^rt  Ctntftor 


Th*  tyntactic  ruUi 

1  Story 

2  Setting; 

3  Episode 

4  Event 

5  Reaction 

6  internal  response 


Setting  Episode 

(State)*  (t^..  an  arbitrary  number  of  states] 
Event  •¥  Reaction 

f  Episode 
)  Change 'Of 'State 
I  Action 

(  Event  +  Event 

Internal  response  Overt  response 
Emotion! 

Desire  / 


TV  iemamie  ruUt  (corrtsponjing  io  tack  syntaetie  rult) 

1  Setting  ALLOWS  episode,  i.e..  makes  it  possible. 

2  State  AND  State  AND  ....  i.e..  logical  conjunction  of  the  states. 

3  Event  INITIATES  reaction.  i.e..  an  external  event  causes  a  mental  reaction. 

4  Event  CAUSES  event,  orevent  ALLOWS  event.  (No  semantic  rule  is  required  for 
the  hrat  three  options  in  the  syntactic  rule.) 

5  Internal  response  MOTIVATESovert  response,  i.e.,  the  response  is  a  result  of  the 
interna)  response. 

6  No  semantic  rule  required. 


rigure  B.t.  Rtimelhart's  Story  Gr&mmar 
from  Johfison'Laird,  p.  363. 

5.3  Story  Grammart 

It  was  precisely  this  textual  connectivity  that  Rumelhatt  and  others  attempted  to  capture  in  story 

yrammars.  These  grammars  codified  stereotypical  scenarios,  found  in  genre  such  as  folk  tales,  into  content- 

independent  structures  in  the  same  spirit  that  grammarians  captured  regularities  in  syntactic  structures. 

Figure  5.1  illustrates  a  simple  example  with  both  syntactic  and  semantic  rules  [Rumelhart,  1975  from 

Johnson-Laird,  1983,  p.  363].  The  greatest  weakness  in  the  story  grammar  formalism  is  its  lack  of  specificity: 

terminal  categories  lack  explicit  definitions  and  semantic  rules  rely  heavily  on  world-knowledge- 

These  formalisms  had  some  utility,  namely  the  classification  of  repetitive  stories.  For  example,  they 

could  capture  the  repetitive  style  of  the  biblical  story  of  genesis  which  essentially  follows  the  pattern: 

DayN  Divint’Sugytsiion  +  oi^ect-creotion-cvent  +  o6;ect-ncmmy 
-f  **Evtn\ng  come  ond  morning  followed,  the  nth  day. " 

Figure  5.2  shows  an  abbreviated  form  and  translation  of  a  popular  Italian  folk-song  which  can  be  interpreted 
by  the  story  grammar  because  of  its  regular  lecursivity.  As  this  example  illustrates,  the  power  of  a  context 
free  grammar  is  unmotivated  since  a  finite  state  machine  which  allowed  for  say  100  repetitions  of  the  event 
— *  event  -h  reaction  rule  would  suffice  for  all  stories  with  this  structure.  In  sum,  these  indefinite  rules  were 
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a  contribution,  bnt  lacked  descriptive  precision.  More  importantly,  they  were  text-type  dependent. 


Alla  Fiera  Dell'Est 

Alla  flera  dell'aat 
par  da«  soldi 
ao  topoUno 
mio  padrs  comprb 

E  venn«  U  gatto 
ehc  si  maapA  U  topo 
che  al  mareato 
int'%  padra  eompr^ 

E  vana«  U  «ana 
eka  morsa  il  gatto 
cha  si  maagU>  il  topo 
eka  al  oiaccato 
mio  padra  compr6 


E  in  flna  il  Signore 
sall'angato  daUa  morta 
•ul  macallaio 
cka  ueeisa  il  toro 
cka  bavva  I'aequa 
oka  spansa  U  fttoco 
cka  brucid  il  bastona 
cha  picchib  il  cana 
cka  morsa  U  gatto 
cha  al  mangib  it  topo 
cha  nl  mareato 
mio  padra  comprb 


At  the  Enstern  Fair 

At  the  Eastern  fair 
for  3  pieces  of  mooajr 
a  iittie  mouse 
mj  tatber  bought 

And  then  came  the  eat 
that  ate  the  mouse 
that  at  the  market 
my  father  bought 

And  than  came  the  dog 
that  bit  the  cat 
that  ate  the  mouse 
that  at  the  market 
my  father  bought 


And  in  the  and  God 
on  the  angel  of  death 
on  the  butcher 
that  killed  the  bull 
that  drank  the  water 
that  extinguished  the  Are 
that  burnt  the  stick 
that  beat  up  the  dog 
that  bil  the  cat 
that  ate  the  mouse 
that  at  the  market 
my  father  bought 


Figure  $.3.  Angelo  Brnnduardi's  Alia  Piera  deU‘€$i 

5.4  Text  Grammar* 

The  solution  to  non-specificity  of  grammatical  tules  was  a  domain  dependent  representation  of  discourse: 
feet  grammars.  This  is  illustrated  by  the  top  level  text  grammar  rule  in  a  generation  system  for  a  neurological 
data  base  for  strokes  [Li  <t  al.,  1986]: 

Cdse-Jleport  — .  Init-lnfo  +  Md.Hrty  4-  Fin-Dtx  +  Phjf.Bxam  +  Lah.Ttt  +  Outeomr 
Expanding  the  fourth  constituent  of  this  rule  we  get; 

Ph$-Etarn  — *  G«ntrni-Btam  +  ...  +  Ctrthtllar-ETam 

Note  that  the  tetminai  and  non-teiminal  categories  are  domain  dependent.  Also,  the  Li  ei  al.  generation 
system  is  KR  dependent.  In  contrast,  GENNY  maintains  a  linguistically  independent  representation  of  the 
underlying  knowledge:  rhetorical  predicates.  Predicate  semantics  link  these  linguistic  primitives  to  GENNY's 
KR.  The  rhetorical  primitives  formulate  the  basis  for  text  schema,  a  discourse  formalism  independent  of 
domain  and  text  type. 

5.5  Text  Schema 

Making  reference  to  Plato’s  visualisation  of  the  true  triangl*^,  Kant  [1787)  writes  “In  truth,  it  is  not  images 
of  objects,  but  schemata  which  lie  at  the  foundation  of  our  pure  sensuous  conceptions."  Recent  studies 
by  the  cross-cultural  psychologist  Elanor  Rosch  [1976]  demonstrate  psychological  evidence  that  natural 
categories  are  represented  in  prototypes.  These  and  other  aigiiinents  lend  credence  to  the  philosophical 
and  psychological  adequacy  of  representing  discourse  in  schema.  Their  empirical  success  is  the  nature  of  this 
dissertation. 

Perhaps  the  first  instigator  of  text  schemas  was  Aristotle  who  distinguished  between  two  discourse 
techniques:  enthymemes  (syllogisms)  and  examples.  Enthyniemes  are  types  of  arguments;  examples  support 
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requestj  for  deAnittoot 

id<ntificatioo 

cofutituciicy 

r«<|uesU  for  AvallAble  Information 

attributive 

constituency 

requests  about  the  difference  between  objects 
compare  and  contrast 

rifure  5.S.  TEXT  schema  [&om  McKeown,  1985,  p.  41]. 

these  arguments.  But  just  as  story  and  text  grammars  suffer  from  generality,  so  these  broad  categories  offer 
little  insight  into  the  cohesive  relation  of  utterances  within  a  multi'Sentential  text. 

Of  late,  grammarians  (Williams,  1893;  Scott,  1938]  have  categorised  the  function  of  paragraphs  in  text 
as  **topic,  general  illustration,  particular  illustration,  comparison,  amplification,  contrasting  sentences,  and 
conclusions.”  Grimes  detailed  this  to  describe  rhetorical  predicates  as  serving  an  organisational  function  in 
discourse  [Grimes,  1975).  Accordingly,  predicates  can  support  or  supplement,  locate  (spatially  or  temporally), 
and  identify.  Searle  [1969,  197S]  noted  that  using  the  wrong  rhetorical  predicate  to  purposefully  flaunt  the 
maxim  of  relevancy  will  cause  a  conversational  implicature. 

McKeown  examined  the  ordering  of  these  communicative  techniques  by  analysing  text  produced  by 
humans.  She  developed  several  schema  which  represented  sequencing  of  predicates  to  achieve  a  particular 
discourse  goal:  attributive,  identification,  constituency,  compare  and  contrast  (figure  5.3). 

McKeown ’s  work  followed  work  on  text  grammar  by  van  Dyk  |1977],  who  argued  that  mere  co»reference 
in  text  was  not  sufficient  for  producing  well-formed  discourse.  Van  Dyk  suggested  ''macro  rules”  which, 
guided  by  a  scheme  representing  the  speaker's  goals,  could  express  propositions  based  upon  their  relevancy 
to  the  discourse  topic.  Moreover,  his  work  suggested  an  interpenetration  of  linguistic  and  factual  knowledge 
which  implies  that  both  a  sense  (propositional  mode!)  together  with  a  significance  (mental  model)  formalism 
ate  at  work.  Such  models  could  well  prove  to  be  the  cohesive  framework  of  text  (such  as  'plot'  in  narrative, 
‘topic’  in  non-fiction,  etc.), 

5.6  Theme-Schemes 

GENNY  embodies  an  attempt  to  explicitly  formulate  and  utilise  common  discourse  strategies  found  in 
human  produced  text.  While  the  discourse  approach  is  similar  to  the  work  of  McKeown  [1986],  the  formu¬ 
lation  is  motivated  by  unique  discourse  requirements,  namely  that  of  providing  definitions  and  comparisons 
of  the  knowledge  and  explanations  of  the  reasoning  within  an  expert  system  for  neuropsychological  diag¬ 
nosis.  Moreover,  there  exists  a  cl  .arer  distinction  in  GENNY  than  in  1£XT  of  the  “mental  model”  and 
the  “propositional  format”.  More  precisely,  the  knowledge  formulation  is  more  unified  and  perspicuous  in 
GENNY  and,  perhaps,  more  representative  of  human  knowledge  structures.  Also,  the  metaage  formalitm  in 
GENNY,  rhetorical  predicates  (discussed  in  the  next  section),  is  more  linguistically  independent.  There  are 
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no  use  of  linguistic  markets  such  as  restrictive  or  non-restriciive  clauses  in  the  message  formalism  but  only 
semantic  indicators  (DDAs). 

A  theme-scheme  uses  the  message  formalism  to  build  text  types.  A  text  consists  of  standard  sequence 
of  rhetorical  predicates  found  to  occur  in  natural  text.  Rhetorical  predicates  classify  the  rhetorical  function 
that  a  piece  of  text  (sentence  or  clause)  performs  within  the  larger  linguistic  framework  (theme-scheme). 
Predicate  groupings  are  not  necessary  and  sufficient  for  well  formed  text,  but  typical.  Text  from  magasines, 
books,  and  advertisements  were  analysed  in  search  of  common  organisational  strategies.  Consider  paragraph 
two  from  the  forward  of  the  Cambridge  University  Varsity  Handbook  [1986]: 


Tha  Varsity  Handbook  is  different.  It  does  not  attempt  to  present  a  unified  and 
neatly  packaged  version  of  the  *real'  Cambridge.  It  is  uritten  and  produced  entirely 
by  students  and  reflects  a  range  of  opinions.  The  *  University '  section  is  an  assort¬ 
ment  of  articles  by  students  on  aspects  of  University  life.  The  ‘Time  Out’  section 
is  intended  to  suggest  ideas  about  hov  to  spend  your  spare  time  in  and  around  Cam^ 
bridge  and  includes  an  extensive  restaurant  and  pub  guide.  The  ‘Information’  section 
is  a  useful  file  of  the  many  services  and  facilities  available  in  the  area. 


Note  how  the  text  first  defines  the  handbook,  tells  about  some  of  its  attributes  (what  it  is  and  what  it  is 
not),  and  then  introduces  each  of  its  constituent  parts  in  ti^n.  ^  From  similar  analysis  on  many  examples, 
the  following  frameworks  of  ordered  rhetorical  predicates  were  abstracted: 


DEFINE 

definition 

attributive 

constituent 

attributive* 


EXPLAIN  COMPARE  X,Y 

cause-effect  definition  X 

attributive*  attribute  X 

definition  Y 
attribute  Y 
compare-contrast  X  Y 
inference 


But  with  subsequent  examination,  a  separate  level  of  abstraction  was  discovered:  8ub*scbema.  These 
can  be  viewed  as  the  sub-acts  which  are  employed  to  realise  a  rhetorical  act  such  as  define,  explain  or 
compare: 


DEFINE 

introduction 

description 

example 


THEME-SCHEMES 

EXPLAIN  COMPARE  X,Y 

reason  introduction  X 

evidence  introduction  Y 

comparison  X,Y 
conclusion 


^  A«  Schenk (1977)  points  out,  people  consistently  le&ve  out  redundontor  obvious  informstion  to  be  more  concise.  Anophoro, 
for  example,  indirectly  refer  to  something  at  the  forefront  of  the  discourse.  Omission  of  connectors  in  causal  chains  are  a 
similar  phenomena.  In  the  extract,  notice  the  suppression  of  the  sentence  introducing  the  sections  in  the  Verstty  Handbook. 
It  is  precisely  this  type  discourse  attenuation  which  Schankian  systems  are  able  to  interpret  by  exploiting  causal  knowledge 
stored  in  conceptual  dependency  structures. 
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SVB-SCnEMA 

introdaction  =>  definition  +  attributive 
example  illustration 

description  constituent 

constituent  ^  attributive*  j  definition* 

conclusion  =>  inference 

reason  cause-effect 

comparison  ^  compare-contrast 

evidence  =>  attributive*  |  definition* 

For  example,  in  response  to  the  simulated  request  Why  do  yoM  think  the  patient  is  instablef^  GENNY 
would  explain: 

Tha  instability  synpton  is  nanifast  bacausa  the  parsonality  observation  and  the  sax- 

activity  observation  indicate  daaaga.  Tha  parsonality  observation  has  a  likelihood 

value  of  four.  Tha  sax-activity  observation  has  a  likelihood  value  of  four. 

Text  analysis  uncovered  other  informational  constructs  such  as  persuasion  — *  position  |  statement 
+  justification.  Also,  cause-effect  predicates  are  often  reversed.  (See  Appendix  A  and  Volume  II  of  this 
dissertation  for  detailed  examples  and  system  tuns.)  For  effective  text,  however,  we  must  realise  these  higher 
level  acts  under  pragmatic  constraints. 

S.7  Rhetorical  Predicates 

The  basic  building  blocks  of  discourse,  rhetorical  predicates  (flP),  describe  the  relative  communicative 
role  an  utterance  plays  within  a  discourse.  The  nomenclature  for  RP  in  GENNY  arises  from  their  function 
within  the  thioad  of  discourse  including:  dehniiion,  attributive,  constituent,  evidence,  illustration,  cause- 
effect,  compare-contrast,  and  inference.  The  selection  of  a  particular  RP  is  motivated  by  the  theme-scheme 
employed. 

A  RP  is  instantiated  with  knowledge  from  the  KB,  having  been  provided  an  argument  which  represents 
the  current  discourse  topic  entity  or  focus  of  attention  (corresponding  to  a  frame  in  the  KB).  Furthermore, 
this  can  depend  upon  the  type  of  discourse  goid  as  with  the  attributive  RP  which  will  be  instantiated  with 
damage  information  if  the  discourse  goal  is  DEFINE,  with  importance  information  if  the  goal  is  EXPLAIN, 
and  with  both  if  the  goal  is  COMPARE.  This  Is  interesting  because  the  discourse  function  relics  not  only 
Oil  its  role  in  discourse  but  also  on  the  type  of  discourse  structure  involved. 

A  predicate  semantics  is  defined  which  relates  the  entities,  relations,  and  values  in  the  KB  with  the 
appropriate  RP  slots.  For  example,  given  the  RP  type,  'definition',  together  with  the  discourse  topic  entity, 
'brain',  the  predicate  instantiation  routine  returns  a  message  with  the  entity,  superclass,  and  DDA. 

(definition  ((brain)) 

((organ)) 

((location  (skull  human))  (function  (understanding)))) 

Depending  on  the  context  (such  as  the  past  focus  of  information  as  well  as  the  amount  of  given  new  infor¬ 
mation)  the  message  could  eventually  be  realised  as  A  brain  is  on  organ  for  iinderslanding  locaidi  w  ihr 
human  skull.  The  complete  predicate  semantics®  are  documented  in  volume  11,  section  6. 

The  predicate  semantics  are  domain  independent,  as  illustrated  by  generation  from  two  knowledge  bases  (brain  and 
photography  faults).  The  semantics  are  knowledge  representation  specific  and  would  have  to  be  redefined  if,  for  example, 
a  script  fSchank  and  Abelson,  1977]  formalism  replaced  the  frame  KB.  Given  the  system  modularity,  the  amount  of 
programming  effort  would  be  minimal . 
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While  GENNY’S  theme-schemes  and  their  corresponding  rhetorical  predicates  model  common  discourse 
strategies  employed  by  humans,  these  alone  will  not  generate  well-connected  and  plausible  text.  Humans 
use  knowledge  of  focus  of  attention  as  well  as  knowledge  of  context  to  decide  what  to  utter.  In  this  light, 
the  selection  and  realisation  of  the  RP  is  constrained  by  pragmatic  information,  which  we  now  discuss. 


Chapter  6 


PRAGMATICS 


Without  knowing  the  force  of  words  it  is  impossible  to  know  men. 
Confucius,  Bk  XX,  3 


6.1  Introduction 

When  reviewing  the  pragmatics  literature  one  state  of  affairs  becomes  immediately  evident:  termino*- 
logical  chaos  and  inconsistency.  To  begin  with,  the  scope  of  pragmatics  itself  is  ill-defined.  Oversimplying, 
it  includes  the  communicators'  identities,  their  knowledge,  intentions  and  beliefs,  as  well  as  the  temporal 
and  spatial  setting  of  the  speech  act:  context.  Pragmatics  has  been  contrasted  with  grammar  (in  the  broad 
sense  incorporating  phonology,  syntax,  and  semantics): 

(Grommarij  are  theories  about  the  structure  of  sentence  types  . . .  Pragmatic  theories,  in  con¬ 
trast,  do  nothinp  to  explicate  the  structure  of  linguistic  constructions  or  grammatical  properties  and 
relations  . . .  They  explicate  the  reasoning  of  speakers  and  hearers  tn  working  out  the  correlations 
in  a  context  of  sentence  tokens  with  a  proposition.  In  this  lespeci,  a  pragmatic  theory  is  part  of 
performance.  [Katj,  1977,  p.  19) 

But  clearly  some  contextual  features  effect  grammatical  structure  We  select  the  passive  over  the  active 
voice  to  stress  what  is  normally  the  object  by  promoting  it  to  the  subject  position.  Consider: 

(a)  John  kit  Mary  with  the  stick. 

(b)  Mary  was  hit  by  John  with  the  stick 

We  select  (b)  to  emphasise  Mary.  If  we  want  to  emphasise  that  John  (not  Mark)  hit  Mary  we  could  use 
extraposition  {It  was  John  who  hit  Mary),  or  intonational  stress  (John  hit  Mary). 

In  fact  the  opposite  of  the  grammatically-based  view  states  that  pragmatics  is  the  interaction  between 
language  and  context  which  yields  particular  grammatical  structures.  While  this  perspective  includes  the 
study  of  deixis  (extra-textual  reference  such  as  “this"  or  “that"),  presupposition,  and  speech  acts,  it  would 
unfortunately  exclude  conversational  implicatures,  as  they  are  non-grammatical.  Its  virtue  is  the  clear 
delineation  and  exclusion  of  sociolinguistics  and  psycholinguistics.  Bui  this  pragmatic-gramniatiral  link 
seems  tenuous  for  when  a  Peruvian  immigrant  speaks  English  with  a  heavy  South  American  accent,  it  is 
more  than  likely  not  the  result  of  a  correlation  between  linguistic  form  and  context.  On  the  contrary,  this 
phonological  eccentricity,  as  with  a  drunk's  slur,  is  unintentional.  However,  selecting  the  Italian  '“tn'“  verb 
conjugation  when  speaking  to  a  lover  on  the  back  of  a  gondola  near  the  Piassa  San  'V'arco  rs  a  pragmatic- 
driven  grammatical  choice. 

Since  the  greatest  weakness  of  this  last  definition  is  the  lack  of  coverage  of  extra  meaning  (e.g.  implica- 
iures),  we  are  led  to  Gaidar's  [1979,  p.  2]  formulation: 
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globally  focused.  Thus  frames  with  a  supet/sub-class  relationships  (part-whole)  are  placed  in  explicit  or 
implicit  focus  based  on  their  distance  from  the  discourse  topic  frame.  If  could  also  be  argued  that  frames  of 
the  same  type  as  the  topic  focus  could  be  placed  in  focus  (i.e.  of  the  same  value  in  the  slot  “type” ).  However, 
it  seems  implausible  that  since  the  left-hemisphere  region  is  focused,  all  other  frames  of  type  “region”  should 
be  focused. 

Hence,  from  a  global  perspective,  knowledge  is  viewed  as  entirely,  partially,  or  not  at  all  relevant. 
Of  course  this  defines  a  vista  with  respect  to  the  level  of  detail  of  relevant  knowledge.  Another  powerful 
mechanism  would  be  the  global  focusing  of  individual  slots  on  information  guided  by  the  particular  overall 
view  or  perspective  of  things.  So  that  while  the  brain  frame  might  be  in  explicit  global  focus,  the  kvista 
on  the  domain  could  determine  the  relevancy  of  functional  versus  structural  knowledge  constrained  by  the 
overriding  perspective  (see  discussion  of  (Hendricks,  1975]  imposing  visibility  constraints  in  [Gross,  1977]). 

6.3  Focus  Shift 

Just  as  discourse  tends  to  center  on  one  topic,  so  too  conversation  is  governed  so  that  it  flows  naturally 
from  one  idea  to  the  next.  Humans  change  focus  locally  (from  utterance  to  utterance)  by  either  direct 
locution  as  in  “We  have  finished  our  discussion  about  X  and  will  now  turn  to  Y”  or  by  implicit  means,  as  in 
“Anyways,  how  is  the  weather?”.  Intuitively,  there  are  “open”  foci,  in  the  sense  that  they  can  be  mentioned 
without  considerable  worry  of  connectivity  as  well  as  “active”  foci,  which  seem  even  more  at  the  forefront 
of  our  minds.  [Grosz,  1977] 

Two  general  principles  seem  to  govern  focus  shift  in  discourse  (Brown  and  Yule,  1983,  p.  67].  The 

Principle  of  Analogy  holds  (hat  things  tend  (o  be  as  they  were  before.  The  Principle  of  Local  Interpretation 

claims  that  if  there  is  a  change,  assume  it  is  minimal.  Assuming  the  Gricean  principle  of  cooperation, 

humans  exploit  these  discourse  principles  and  other  coherence  cues  when  interpreting  text,  tlnfortunate/y, 

these  vague  terms  beg  for  concreteness  within  a  computational  model  of  generation.  I  define  focus  as: 

something  placed  at  the  forefront  of  our  mind  hy  implicit  or  explicit  means,  by  grammatical 
constructs  or  phonological  stress. 

Three  types  of  focus  (motivated  by  [Sidner,  1983]),  operating  at  the  utterance  level,  are  recognised  in 
GENNY:  current  focus  (CF),  past  focus  (PF),  and  future  focus  (FF).  1  define; 

CF  •  generally  the  semantic  actor,  the  subject  of  the  sentence,  the  leftmost  np 
of  the  sentence,  and  given. 

PF  -  past  foci  .'♦ack  -  simulates  a  long-term,  multi-utterance  episodic  memory 

FF  -  generally  semantic  patient,  object  of  the  sentence,  residing  at  the  end 
of  the  sentence  new  information 


McKeown  [1985]  exploited  insights  made  by  Sidner  [1979],  and  controls  focus  choice  by  preferring  pf>- 
tential  future  foci  to  current  focus  as  well  as  preferring  current  focus  to  the  past  current  focu^.  A  final 
alternative  allows  her  to  choose  semantically  related  entities. 

If  we  blindly  follow  the  linguistic  principle  of  analogy,  our  preferred  choice  of  subsequent  focus  shnuld 
be  CF  >  FF  >  PF  in  the  current  discourse  (were  “  means  “is  preferred  to”).  Of  course  with  this 
approach  speakers  would  drone  on  about  one  suhj^^ct  until  exhausting  their  knowledge  or  energy.  ^  In 


2 


This  would  perhaps  be  a  useful  strategy  in  some  situations  («  g-  fitlibuster  during  a  congressional  session,  attempt  to  bore 


at  a  party,  or  simulating  a  one-track  mind). 
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rifur«  9,2.  Predicate  Selection  Flow  Chart. 

I  Selection  constrained  by  focus. 

ordinary  discourse,  however,  speakers  tend  to  shift  to  recently  introduced  or  new  entities  found  in  the  future 
foci  of  the  previous  utterance.  This  suggests  a  promotion  of  FF  in  our  rule  to  obtain  a  focus  preference 
function:  FF  >  CF  >  PF.  If  there  are  multiple  CF  (as  when  comparing  objects),  however,  we  should 
encourage  discussion  of  those  before  moving  on  to  new  topics.  This  is  reflected  in  GENNY  preferring  CF 
^  >  FF  >  PF  when  there  are  multiple  CF.  This  focus  preference  list  (fpl)  plays  a  key  role  in  the  attentional 

algorithm  and  predicate  choice  in  GENNY  (see  figure  6.2).  ^  A  trace  of  the  focus  selection  algorithm  in 

► 

action  is  presented  the  Appendix. 

*  Speakers  are  often  encouraged  to  “stick  to  the  point”,  which  would  suggest  a  constraint  on  the  pro¬ 
liferation  of  new  foci  of  attention.  GENNY  is  discouraged  from  straying  away  from  the  discourse  topic  by 

r  - 

*  Fillmore  [1977]  luggetrs  that  entitiet  in  an  event  arc  per§ptcti9ii*d  and  claims  a  need  for  a  salicncy  hierarchy  -  a  priority 

*  list  of  foreground  choices  which  can  be  used  to  decide  on  focus.  He  suggests  an  animacy  hierarchy  can  aid  perspectivisation 

I  decisions.  Given  a  choice,  egocentric  people  tend  to  focus  Arst  on  humans,  then  animate  things,  and  finally  on  inanimate 

p  objects.  Animacy  knowledge  could  easily  be  added  to  lexical  entries  and  GENNY’s  focxis  algorithm  could  be  adapted  to 

L  make  such  decisions.  There  was  no  time  for  implementation. 
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knowledge  vista  constraints  which  limit  the  knowledge  base  available  for  discourse  construction.  Further- 
more,  when  GENNY  runs  out  of  new  things  to  say,  she  can  always  return  to  the  original  topic  of  discussion 
as  it  will  be  the  first  item  to  be  placed  on  the  PF  stack. 

[McKeown,  1985]  suggests  the  need  for  an  additional  focal  selection  for  implicitly  related  entities.  In 
GENNY,  a  global  focus  of  attention  places  related  entities  into  the  knowledge  vista.  Interestingly,  interfacing 
to  a  rule* based  representation  would  require  a  global  focus  routine  with  semantic  knowledge  of  related  entities. 

Of  course  a  more  sophisticated  memory  device  for  past  foci  might  have  decay  register  whereby  with 
time  (say  measured  by  the  number  of  utterances  produced),  previously  focused  entities  fade  away  from  the 
forefront  of  discourse.  In  addition,  a  spreading  activation  mechanism  (similar  to  that  employed  in  CAPTURE 
[Alshawi,  1983])  could  encourage  frames  that  are  related  to  the  current  focus  of  attention  to  become  mote 
strongly  in  focus  as  they  are  spoken  about  or  referred  to.  A  provocative  idea  would  be  to  use  the  amount 
(and  strength)  of  KB  links  to  the  current  focus  to  suggest  future  foci.  Local  and  global  focus  mechanisms 
remain  an  exciting  area  for  further  research. 

6.4  Pragmatic  Effects  on  Surface  Form 

Just  as  focus  constraints  augment  text  coherence,  so  grammatical  choice  constrained  by  context  can  act 
as  a  binder  of  discourse.  In  GENNY,  context  consists  of  given  entities,  mentioned  previously  in  discourse,  and 
new  entities,  introduced  in  the  current  utterance  for  the  first  time  in  discourse.  Not  rules  but  generalities 
govern  the  speaker’s  referential  and  grammatical  choices  [Brown  and  Yule,  1983,  p.  189]  with  regard  to 
content: 

•  speakers  usually  introduce  new  entities  with  indefinite 

referring  expressions  and  with  intonational  prominence 

•  speakers  usually  refer  to  current  given,  entities  with 

attenuated  syntactic  and  phonological  forms. 

Exploiting  these  regularities  in  the  contexts  of  discourse,  hearers  are  able  to  interpret  co-rcferential  text. 
Conversely,  these  generalities  allow  us  to  make  lexical  decisions  when  building  syntactic  structures. 

For  example,  when  generating  the  first  utterance  in  a  define  theme-scheme,  where  the  discourse  topic  is 
brain,  GENNY  says  A  brain  is  an  organ  located  tn  the  human  skull.  Notice  both  the  subject  and  object  have 
indefinite  articles  as  both  are  new.  While  it  can  be  argued  that  the  noun  phrase  within  the  prepositional 
phrase  could  also  use  an  indefinite  article,  as  it  too  represents  new  information,  the  adjective  specifies  a 
human  skull  and  therefore  the  definite  article  is  chosen. 

Just  as  speakers  utilise  lexical  devices  to  mark  new  information,  so  too  yjren  entities  are  referred  to 
with  attenuated  syntactic  forms.  GENNY  exploits  given  information  to  select  definite  noun  phrases  and 
anaphora  (see  section  8.3).  For  example,  after  introducing  the  entity,  “brain",  GENTRY  can  refer  to  it  as 
“the  brain”,  since  it  is  given.  Furthermore,  if  “brain"  is  at  the  forefront  of  the  intended  hearer's  mind  (i.e. 
was  the  past  CF),  the  anaphora  can  be  used  co-referring  to  it.  This  decision  tacitly  assumes  the  principle  of 
analogy  (things  tend  to  be  the  same)  together  with  the  principle  of  local  interpretation  (change  is  minimal). 
Anaphor  is  discussed  further  in  section  8.4. 

Syntactically,  focus  suggests  choice  between  active  and  passive  constructs.  There-insertion  is  used  to 
promote  the  object  to  the  subject  position  were  the  passive  construction  is  not  possible  (e.g.  with  a  copula 
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verb).  It<extrapositioo  can  suggest  focal  stress  (e.g.  was  John  who  hit  JUP).  These  are  detailed  in  section 
8.2.  But  ftist  the  rhetorical  message  must  be  interpreted  by  the  semantic  component,  the  first  module  of  the 
threefold  tactical  generator  which  includes  semantics^  reiutions,  and  $yntax. 


36 


Chapter  7 


SEMANTICS 


You  do  not  understand  this  parable  f  How  then  are  you  going  to  understand  other  figures  like  it? 

Mark  4:13.U 

7.1  Introduction 

Tactical  genctation  components  must  map  a  rhetorical  message  onto  surface  form.  In  GENNY  this 
process  involves  translation  from  the  rhetoric^  proposition  onto  a  semantic  case  grammar  (this  chapter), 
a  relational  grammar  (chapter  8),  a  syntactic  grammar  (chapter  9),  and  finally  onto  surface  form  via  mor¬ 
phology  and  orthography.  Figure  7.1  relates  these  levels  together  with  the  previously  discussed  message 
formalism  and  pragmatics  information.  The  motivation  for  these  distinct  levels  of  analysis  is  the  lack  of  pre¬ 
vious  generators  to  map  semantics  onto  syntax  in  a  well-motivated  fashion  (e.g.  McKeown's  hand-encoded 
dictionary  of  phrasal  constituents). 

7.2  Semantic  Interpretation  of  Rhetorical  Propositions 

A  variety  of  semantic  representations  are  present  in  the  literature  including  deep  case  relations,  CD 
structures,  and  truth  conditions  or  possible  worlds  [Fillmore,  1968;  Schank  and  Abelson,  1977;  Montague, 
1974].  GENNY  incorporates  two  of  these  meaning  systems:  Montague  semantics  for  interpretation  [Pulman, 
1987]  and  case-based  semantics  [Fillmore,  1968,  1977]  for  generation.  Montague  semantics,  implemented 
using  the  familiar  A-reduction  mechanisms,  rely  on  semantic  entries  for  each  lexical  entry  together  with  a 
semantic  component  for  each  grammatical  rule.  Conversely,  the  semantic  role  in  the  case  representation  is 
obtained  from  the  rhetorical  predicate. 

GENNY  translates  the  predicate  into  deep  case  roles  of  action,  agent,  patient,  instrument,  location, 
function,  external  location,  beneficiary,  manner,  time,  and  state.  ^  GENNY  interprets  the  message  formalism 
in  three  stages.  First,  the  rhetorical  predicate  type  is  mapped  onto  an  action  guided  by  the  function  the 
utterance  plays  in  discourse  as  well  as  the  relationships  of  the  entities  in  the  message.  Thus,  a  cause-effect 
message  containing  an  object  would  utilise  the  verb  have  (e.g.  The  hratv  has  damage  because  .  . . )  whereas 
evidential  knowledge  would  suggest  other  actions  (e.g.  The  msiabihiy  observation  is  made  because  ...  or 
The  left-cognitive-flezihility  symptom  is  manifest  because  . . .). 

^  A  variety  of  case  role*  have  been  suggested  (Fillmore  1908;  Schank  1975;  Grimes  1975).  The  case  lists  range  in  length  from 
the  most  terse  (nominative,  ergative,  locative)  (Anderson,  1971],  to  a  wider  cover^l^e  illustrated  recently  [Sparck  Jones 
and  Boguraev,  1987). 
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RHETORICAL  PREDICTATE 
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RELATIONAL  FUNCTION 
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SYNTACTIC  FUNCTION 


0 


the  left-hemisphere 
is 

a  region 

for  feature-recognition 
located  in  the  human  brain 


SURFACE  FORM 


The  left-hemisphere  is  a  region  for  feaiure-recogniiion  located  m  the  human  broin. 

Figure  T.i.  Mapping  from  proposition  to  surface  in  GENNY. 

^  Secondly,  case  roles  are  are  selected  based  on  their  position  in  the  message  formalism.  Finally,  any 

modifiers  which  originate  from  the  dda  are  interpreted  using  the  semantic  markers  location,  etiemal-location, 
function,  instrument,  which  eventually  translate  to  prepositional  phrases  of  '*located  in”,  “on”,  “with”,  and 
“for”.  This  treatment  is  certainly  very  limited,  indeed  testing  revealed  a  need  for  more  semantic  markers  and 
their  corresponding  deep  case  roles  to  represent  and  generate  other  surface  forms  (e.g.  “from”  for  origin). 
y  This  deep  case  semantics  is  documented  in  Volume  11. 

^  The  case  formalism  has  received  criticism  that  it  is  a  mere  notational  variant  of  some  preferred  theory 

and  at  best  is  a  mere  taxonomy.  Fillmore,  1977,  p.  70]  clarifies  the  purpose  of  the  deep  case  proposal 
^  as  a  recognition  of  a  case-level  organisation  of  sentences  rather  than  a  complete  grammatical  model.  He 

recognises  the  need  for  “a  level  of  representation  including  the  grammatical  relations  subject  and  object.” 
^  This  level  is  represented  as  the  relational  function  in  GENNY  which  we  now.describe. 
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RELATIONAL  FUNCTION 


ilfan  is  a  network  of  relationships  and  these  alone  maiier  to  him. 
St.  Bxupery 


8.1  Introduction 

Researchers  in  Nt  interpretation  have  recognised  the  utility  of  relationai  ideas.  2n  GUS  (Genial  Un¬ 
derstanding  System)  [Bobrow  et  al.  1977],  for  example,  parsing  is  completed  in  two  phases.  First  input 
is  parsed  into  grammatical  registers  (subject,  predicate,  direct-object,  indirect-object)  with  prepositional 
phrases  placed  in  a  modiher  list.  Next  the  result  is  analysed  using  verb-case  roles.  Winograd  [1983,  p.  324] 
points  out  that  in  a  language  with  a  more  developed  case  system  (e.g.  Russian  and  Japanese),  the  use  of 
verb-centered  analysis  could  be  even  more  beneficial.  Some  inter-lingual  studies  also  support  a  relational 
level  of  analysis  [Perlmutter,  1980]. 

RG  embodies  a  hierarchy  of  sentence  participants  so  that  in  English,  for  example,  the  subject  is  1, 
the  direct-object  is  2,  and  the  indirect-object  is  3.  Rules  can  then  capture  generalities  like:  to  form  the 
passive,  promote  2  to  1  (direci’Object  to  subject).  In  this  case  the  1  element  becomes  chomeur  (French  for 
'unemployed'),  so  it  can  either  be  dropped  from  the  sentence,  or  transferred  into  a  satellite  phrase. 

Current  generators  have  largely  ignored  the  promise  of  relational  grammar.  McKcown’s  dictionary  com¬ 
ponent,  for  example,  translates  knowledge  base  tokens  into  phrasal  level  constituents  via  a  hand-encoded 
dictionary  [see  McKcown,  1985,  p.  167).  Clearly,  this  is  linguistically  insufficient,  computationally  expen¬ 
sive,  and  psychologically  implausible.  In  contrast,  GENNY  has  an  independent  representation  of  relational 
function,  affording  the  power  of  relational  grammar  yet  maintaining  a  well-tested,  traditional  phrase  struc¬ 
ture  analysis.  GENNY’s  uses  syntactic  experts  to  build  grammatical  components  (e.g.  subject,  object, 
predicate)  using  both  domain  tokens  and  pragmatic  information.  For  example,  when  forming  noun  phrases, 
indefinite  articles  are  selected  for  new  information  whereas  definite  articles  are  preferred  for  given  entities 
(discussed  in  section  8.3).  (Even  more  sophisticated  mechanisms  are  necessary  to  ensure  use  of  minimal 
referring  expressions  while  still  uniquely  identifying  an  object  or  concept  in  discourse.) 

One  obvious  approach  is  to  incorporate  giainmalical  distinctions  into  syntactic  grammars,  for  this 
certwnly  would  decrease  complexity.  Within  the  standard  transformational  theory,  for  example,  we  could 
call  the  first  noun  phrue  in  a  sentence  its  subject.  However,  this  only  marks  the  syntactic  structures  of  the 

^  Of  course,  one  drawback  of  ibis  approach  is  the  computational  expense  of  a  full  grammatical  analysis.  Accordingly,  there 

is  a  speed  versus  completeness  trade-ofi 
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tiee  since  ‘subject*  and  ‘inditeci  object*  play  no  role  at  this  level  of  representation.  In  more  comprehensive 
paradigms  (e.g.  systemic  or  case  ^  grammar),  relational  function  pUys  a  much  greater  role  in  the  linguistic 
analysis. 

8.2  Focal  Stress  and  Surface  Form 

During  generation,  GENNY  assigns  focal  prominence  to  relational  constituents  based  on  pragmatic 
constraints  of  relevancy.  Assume,  for  example,  a  sentence  is  being  generated  were  the  message  formalism 
translates  to  the  semantic  cases:  subject  o  alcoholism,  object  o  amnesia,  and  predicate  causes.  This 
might  realise  as  Alcoholism  causes  amnesia. 

Assume,  however,  that  the  focal  shift  algorithm  determines  that  the  next  utterance  is  best  described 
from  the  perspective  of  amnesia.  The  RG  would  indicate  that  to  achieve  this  the  2  (object)  should  be 
promoted  to  1  (subject).  In  the  typical  case,  the  predicate  would  be  passivised  (be  +  past  participle  of  main 
verb),  the  preposition  ‘by’  would  be  added  before  the  new  constituent  of  the  2  (object)  register.  Generation 
would  eventually  culminate  in  the  surface  form:  Amnesia  ts  caused  by  alcoholism. 

However,  there  are  some  verbs  (like  the  one  in  this  sentence)  which  cannot  be  passivised.  In  these  cases 
(e.g.  be,  have)  syntactic  ordering  must  account  for  focal  prominence.  So  we  can  utter  “It  was  a  brain  tumour 
that  killed  the  patient  (not  a  stroke)”  to  emphasise  the  semantic  patient,  “tumour”.  GENNY  can  utilise 
there-insertion  and  it-extraposition  to  achieve  this  type  of  forefronting. 

Not  only  prominence  (intonational  or  structural),  but  also  lexical  connectives  can  sew  together  discourse. 
The  rhetorical  function  of  an  utterance  in  discourse  suggests  appropriate  connectives  (e.g.  illustration 
“for  example”,  cause-effect  — »  “because”).  These  are  inserted  at  this  relational  level  and  serve  not  only 
as  intrasentential  markers,  but  more  importantly,  indicate  the  discourse  role  a  sentence  plays  in  the  overall 
text. 

8.3  Syntactic  Experts 

Relational  constituents  (subject,  predicate,  objects,  and  modifiers)  are  built  with  procedures  which 
are  experts  in  building  syntactic  phrases  which  realise  these  relational  constituents.  Provided  the  semantic 
message  together  with  syntactic  and  pragmatic  constraints,  these  procedures  attempt  to  generate  well-formed 
constituent  phrases.  Syntactic  experts  operate  for  three  grammatical  constituents  in  GENNY:  noun  phrases 
(NP),  verb  phrases  (VP),  and  prepositional  phrases  (PP). 

The  NP  builder,  for  example,  consists  of  the  pattern:  NP  quantifier  article  adjective-list 
nominal-modifter-list  head  post-modifiers.  Articles  are  selected  based  on  both  syntactic  constraints  as 
well  as  pragmatic  constraints  of  focus  and  context  (given/new)  as  outlined  in  figure  8.1. 

For  example,  the  syntactic  specialist  is  able  to  generate  the  utterance  Vision  is  a  sympfom  lovaftd  in 
the  left-occipital  lobe  with  a  /unction  of  reconising  images.  “Vision",  a  mass  noun,  requires  no  article.  Also, 
GENNY’s  noun  phrase  specialist  realises  that  complex  noun  phrases  composed  of  hyphenated  words  are 
distinguishable  from  simple  nouns  (e.g.  the  kft-occipital  lobt  rather  than  o  Ufl-occipital  lobe)  (see  section  9. 
volume  11).  Note  also  that  that  the  articles  are  morphologically  consistent  with  the  subsequent  lexical  item 
(discerning  between  “a”  and  “an”).  It  was  found  empirically  that  article  agreement  is  dependent  not  just  on 

^  Here  CMC  grammar,  aa  opposed  to  deep  ca«e  structure,  describes  a  much  wider  range  of  grammatical  phenomena:  from 

deep  to  surface  formats. 
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Tlgur*  t.i.  Article  Selection  Algorithm 

the  head  of  the  noun  phrase  but  on  the  subsequent  linear  word.  This  is  language  dependent.  In  Italian,  for 
example,  articles  agree  with  the  head  of  the  noun  phrase  but  are  modified  by  local  morphology.  Compare: 

gli  urtisli  slortci  i  6et  ntgozi 

and 

the  historic  artists  the  beautiful  shops 

This  evidence  supports  the  design  of  a  modularised  syntactic  component  interfaced  to  a  language  independent 
relational  representation. 

No  examples  of  quantifiers  were  generated,  although  this  would  clearly  be  important  provided  an  un- 
derlying  logic  KR,  for  example.  ^  The  ac^ective-lisi  incorporates  adjectives  and  ordinals  while  the  nominal- 
modifiei'list  includes  only  nominals.  Compound  nouns  were  generated  on  the  assumption  that  the  message 
order  passed  from  the  semantic  component  would  indicate  the  head  noun  as  distinct  from  modifying  nouns. 
This  analysis  was  mirrored  in  the  grammar  (see  grammar  rule  np— »noun+noun  in  section  12.1,  volume 
II.)  The  proper  handling  of  compound  nouns,  however,  is  a  major  enterprise  involving  word  sense,  nominal 
phrase  structure,  and  semantic  word  relations  (Sparck- Jones,  1985J. 

The  VP  builder  consists  of  the  pattern  VP  ^  verb  or  VP  auadliary  Terb[past  participle] 
particle,  depending  upon  the  provided  voice.  An  active  voice  will  return  the  lexical  entries  for  the  provided 
semantic  action.  In  contrast,  a  passive  voice  will  indicate  to  the  routine  to  select  an  appropriate  auxiliary 
(e.g.  "be")  followed  by  the  lexical  entries  for  the  verb,  ^  followed  by  an  appropriate  particle  if  necessary, 
eventually  to  realise  as  "is  contained  in"  or  "is  indicated  by",  for  example. 

*  Interestingly,  quantifiers  are  computable  from  slot-filler  type  networks  [McKeown,  1986]. 

^  Lexical  entries  consist  of  only  root  or  irregular  forms  of  words.  The  feature  list  for  the  plural  entry  of  the  verb  "contain”, 
listed  as  (verb  trans  plur  pres  p3),  is  modified  to  (ve^  trans  phir  pres  en)  to  form  the  past  participle. 


Mark  T.  Maybury 


Finally,  a  PP  buildft  follows  the  pattern  PP  =>  preposition  NP,  recursively  calling  the  NP  builder  to 
complete  its  description  (passing  along  pragmatic  information).  The  preposition  is  provided  to  the  routine 
by  translating  the  cemantic  case  role  given  with  the  entity.  GENNY  current  incorporates  four  case  roles 
which  eventually  realise  as  PPs;  location  (‘^located  in'*),  external-location  (“on"),  instrument  (“with")  and 
function  (“for"). 

A  nice  property  is  that  GENNY  degrades  gracefully  when  unable  to  translate  or  build  certain  phrasal 
constituents  by  attempting  to  utter  what  she  can.  Pot  greater  perspicuity,  future  work  could  investigate 
implementing  GENNY's  procedural  syntactic  experts  as  production  rules  as  in  [Tait,  1985].  Also,  due  to 
time  constraints,  work  on  lexical  selection  was  limited  [but  see  Sparck  Jones  and  Tait,  1984]. 

9.4  Anaphora 

The  interpretation  literature  suggests  that  [Hobbs,  1976  in  Grishman,  1986]  anaphot  resolution  should 
incorporate  syntactic  knowledge  to  constrain  the  search  space  and  examine  noun  phrases  of  the  previous 
sentence  first,  followed  by  those  of  the  sentence  before  that.  Parse  trees  are  seari'hed  breadth  first,  top-down, 
and  left-right  so  that  subject  and  object  are  tested  first.  Recently,  Sidner  [1983]  developed  focus-based 
anaphoi  interpretation  algorithms.  Carter  [1985|,  developed  a  shallow  processing  approach  to  anaphor 
resolution. 

GENNY  performs  analysis  for  the  restricted  set  of  intersentential  definite  pronominal  anaphora.  It  is 
in  the  NP  builder  that  the  decision  to  anaphorise  is  made.  The  algorithm  to  decide  basically  states  that  if 
the  agent  is  in  the  list  of  past  current  foci  and  the  agent  is  given,  then  pronominalise.  Referring  expressions 
ate  selected  from  set  of  possible  pronominals  by  unifying  syntactic  features  (person,  number,  gender,  and 
animacy  (proposed)).  *  During  testing,  GENNY  produced: 

A  brain  is  an  organ  for  understanding  located  in  the  human  skull.  It  has  an  impor* 
tance  value  of  ten.  It  contains  two  regions;  the  left-hemisphere  and  the  right- 
hemisphere.  The  left-hemisphere,  for  example,  has  the  feature- recognition  function 
located  in  it . 

Of  course  the  subject  in  sentence  two  and  three  is  attenuated  since  it  is  forefronted  in  the  reader's  mind. 
It  is  interesting  to  note  however,  that  the  pronominaJisation  in  sentence  four  is  ambiguous.  In  the  message, 
“it"  actually  replaces  “brain",  yet  in  the  utterance  my  own  interpretation  seems  to  favour  resolution  as 
“left-hemisphere".  Apparently,  longer  texts  will  require  reference  mechanisms  which  incorporate  more  than 
just  syntactic,  recency  and  focus  information.  It  seems  that  both  locutionary  as  well  as  illocutionary  context 
is  necessary.  ® 

In  summary,  RG  serves  as  a  natural  symantico-syntax  link.  It  promises  to  be  a  language  independent 
representational  level.  In  preliminary  studies  with  Italian.  RG  appears  a  sufficiently  robust  formalism  to 
handle  at  least  simple  active  and  passive  Italian  sentences  within  GENNY.  Of  course  the  lexicon,  grammar, 
and  syntactic  specialists  would  have  to  be  implemented  for  Italian,  but  the  remaining  (majority)  of  the 
system  would  remain  constant.  We  now  see  how  relational  constituents  are  mapped  onto  surface  form. 


^  See  anaphora  module,  section  7  in  Volume  II  for  details. 

^  If  we  introduce  both  "Alxhcimer’s  disease"  and  "Huntington’s  disease"  in  discourse,  subsequent  nominal  reference  must 
uniquely  identify  the  entity  in  discussion.  The  word  "disease”  is  insufficient.  Referential  procedures  are  responsible  for 
avoiding  lexical  ambiguity. 
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SYNTACTIC  FUNCTION 


**When  I  use  a  word”  Humpty  Dumpty  said,  tn  a  rather  scornful  tone,  “ti  means  just  what  I  choose  ti  to 
mean  -  neither*  more  nor  less.” 

“The  question  is,”  said  Alice,  “whether  you  can  make  words  different  things.” 

“The  question  ts,”  satd  Humpty  Dumpty,  “which  is  to  be  master  -  that’s  all. 

Through  the  Looking  Glass 


9.1  Introduction 

Within  (he  functional  paradigm  there  are  titro  major  approaches  to  gen^^ration  at  the  syntactic  leveJ: 
systemic  grammars  and  functional  uniAcation  grammars.  Systemic  grammars  [Halliday,  1976]  distinguish 
between  two  levels  of  organisation:  choice  and  structures  that  realise  choice.  Language  is  classified  as 
network  of  systems  and  generation  consists  of  selecting  from  alternatives. 

One  advantage  of  systemic  grammars  is  efficiency.  Unfortunately,  there  are  several  disadvantages.  Sys¬ 
temic  grammars  introduce  several  complexities  including  lack  of  flexible  ordering  or  omission,  overlapping 
or  discontinuous  constituents,  and  agreement  across  systems  (see  [Winogiad,  1983]  for  a  detailed  discus¬ 
sion).  Even  the  largest  systemic  grammar  docs  not  have  the  breadth  and  clarity  of  current  transformational 
grammars.  It  remains  to  be  seen  what  systemic  grammar  will  yield  in  grammatical  coverage. 

Conversely,  unification  grammars  offer  a  well-tested  formalism.  Unfortunately,  grammars  of  significant 
siie  are  sluggish.  Two  alternatives  ate  Functional  Unification  Grammar  (FUG)  [Kay,  1979]  and  other  non¬ 
functional  Generalised  Phrase  Structure  Grammar  (GPSG)  [Gasdar,  1982]  which  can  encode  function  in 
feature-value  pairs.  While  the  former  offers  a  uniform  specification  of  function  (semantic,  grammatical, 
syntactic  and  lexical),  it  suffers  many  technical  problems  particularly  with  a  grammar  of  any  significant 
siae.  First,  there  arc  selectional  problems  when  alternatives  are  present  ‘  as  well  as  problems  with  fragment 
generation.  This  remains  an  area  for  further  exploration. 

The  alternative,  GPSG,  is  well-studied  and  accounts  for  many  complex  phenomena  including  agreement 
and  morphology,  related  forms,  structural  anibiguitv.  and  unbounded  movement.  Meta-rules  allow  conve¬ 
nient  description  of  generalities  in  rules.  Features  provide  the  possibility  of  including  pragmatic  registers 
(e.g.  focus  or  given/new)  directly  in  the  grammar  to  allow  the  grammar  to  orchestrate  a  broader  range  of 
linguistic  phenomena.  Finally,  semantic  rules  associated  with  individual  grammar  rules  have  shown  promise 
in  interpretation  [Montague,  1974]. 

^  McKeown  who  detaiU  FUG  in  TEXT,  for  example,  side  steps  this  problem  by  always  taking  the  first  successful  alternative. 


Mark  T.  Maybury 


9.2  Grammar:  GPSG  +  Features 

Phrase  Stractuie  Grammar  (PSG)  is  based  on  an  extension  of  Context  Free  Grammar  (CFG).  Typical 
rewrite  rules  such  as  — »  NP  VP”  are  augmented  with  features  which  constrain  the  possible  well-formed 

syntactic  trees.  These  rules  can  be  sophisticated  enough  to  cover  agreement,  morphology,  missing/moved 
constituents,  etc.  For  example,  the  active  sentence  level  rule  in  GENNY  is: 

S  [(type  declarative)  (voice  active)] 

RP  [(count  1)  (person  2)  (gender  4)]  -I- 
TP  [(count  1)  (person  2)  (tense  3)  (voice  active)] 

For  illustrative  purposes,  the  capitalised  characters  indicate  non-terminal  symbols,  followed  by  a  list  of 
feature-value  pairs.  Note  that  some  feature  values  are  symbols  while  others  are  variables  (integers)  which 
indicate  feature  agreement.  In  the  rule  above,  for  example,  the  count  (e.g.  plural)  and  person  (e.g.  third- 
per.son)  feature  values  must  agree  as  indicated  by  variables  1  and  2.  The  voice  feature  would  simply  be 
changed  to  passive  to  state  the  top-level  rule  for  passive  sentences.  The  grammar  includes  rules  for  activ#* 
and  passive  sentences,  multi-sentential  connectivity,  and  relative  clauses,  along  with  phrasal  constructs  (np. 
vp»  PP,  etc.).  The  documented  grammar  is  listed  in  full  in  volume  II  along  with  mechanisms  such  as 
pteparsers  for  eIRciency. 

For  clarity,  each  rule  has  an  associated  name  (avdeo  — »iip-t  vp,  for  above).  Also,  each  rule  contains 
a  A-calculus  meaning  representation,  which  is  used  to  convert  syntactic  trees  to  logical  form  [Pulman,  1987). 
This  is  intended  for  future  interpretive  use  following  the  psycholinguistically  motivated  use  of  bi-directional 
grammars.  ^ 

9.3  Unification 

The  process  of  generation  and  (proposed)  parsing  is  handled  by  the  process  of  unification.  Unification 
consists  of  using  the  grammar  and  features  to  build  constituents  which  are  placed  on  a  well-formed  sub¬ 
string  table  (WFSST)  or  chart  [see  Pulman,  1987  for  detail).  The  unifier  percolates  features  up  the  chart  (by 
matching  and  then  binding  feature  variables),  and  generates  all  possible  syntax  trees  from  the  given  lexical 
entries.  At  the  end  of  the  generation,  another  routine  simply  reads  off  the  completed  trees  (or  partial  trees, 
as  in  the  case  of  ellipsis  or  fragments).  The  unbound  variables  in  the  syntax  tree  are  bound  with  values  from 
their  agreeing  constituents.  The  documented  code  for  these  routines  can  be  found  in  Volume  II.  section  10. .3. 


Some  interesting  work  Hm  been  done  using  PROLOG  with  bi-directional  granunars  [Simons  and  Chester,  1982]. 
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9.4  Lexicon 

The  dictionary  sub'system  built  for  GENNY  contains  dictionary  generation,  access,  edit,  and  removal 
functions.  Lexical  entries  are  listed  in  the  format  <.  entry  syntax  semantics  realisation  >  where  entry  refers 
to  a  token  in  the  expert  system,  syntax  includes  categorical,  agreement  and  morphological  information, 
semantics  includes  a  logical  form  meaning  representation  of  the  lexical  item,  and  realisaiton  indicates  the 
actual  translation  of  the  domain  token  into  natural  language.  Variables  were  introduced  into  the  syntax 
declarations  to  minimise  repeat  listing.  Future  plans  include  adding  syntactic  features  of  humanity,  animacy, 
and  abstractness  for  use  in  anaphor  selection  as  well  as  in  lexical  selection  (e.g.  “who"  or  “which"  in 
subordinate  clauses). 

To  facilitate  portability,  a  kernel  dictionary  was  developed  which  contains  frequently  used  words  such  as 
numbers,  determiners,  pronouns,  prepositions,  punctuation,  conjunctions,  connectives  and  core  verbs.  This 
was  exploited  when  developing  a  second  KB  in  photography  for  system  evaluation. 

9.5  Surface  Morphology  and  Orthography 

To  complete  the  production,  GENNY  linearises  the  output  from  the  syntactic  generator,  synthesis  lexical 
entries  morphologically,  then  applies  final  orthographic  conventions.  The  morphologically  synthesis  is  guided 
by  syntactic  features  on  lexical  entries. 

Orthographic  conventions  include  text  layout  (spacing,  pagination,  new  lines)  and  conventions  such  as 
capitalisation  and  punctuation.  Text  layout  was  restricted  Co  leaving  a  blank  between  lines.  New  lines 
were  capitalised  and  punctuated.  Use  of  pragmatic  information  at  this  level  could  suggest,  for  example,  use 
of  capitalisation  or  exclamation  marks  for  emphasis.  Abbreviation  also  could  be  used  for  terseness  when 
speaking  to  an  expert. 

9.0  Discussion 

GPSG  provides  a  clear  and  perspicuous  syntactic  formalism  from  which  to  implement  syntax.  While 
the  current  representation  offers  much  promise,  there  are  still  many  linguistic  phenomena  which  require 
further  investigation  such  as  ellipsis,  ill-formed  language  and  structural  ambiguity.  Also,  further  interlingual 
investigations  are  necessary  to  fully  realise  the  possibilities  of  syntax  independence.  Finally,  the  problems 
involved  in  bi-directional  grammars  (e  g.  lexicon  development  and  semantic  consistency)  need  to  be  closely 
examined. 

Notwithstanding  the  need  for  extensive  testing  of  these  components,  there  appears  to  be  both  a  theo¬ 
retical  and  pragmatic  bias  toward  this  representation.  The  syntactir  independence  aids  portability  between 
languages.  Moreover,  the  bi-direclionality  of  the  grammar  lends  psychological  credence  with  regard  to  cog¬ 
nitive  efficiency.  The  scope  and  limitations  of  this  formalism  remain  to  be  explored. 
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Chapter  10 

TESTS  AND  EVALUATION 


What  is  the  difTerence  between  an  optical>lens  and  an  aperture? 

An  optical’lens  is  a  component  for  focusing  located  in  a  camera.  It  has  a  relative  importance  value 
of  nine  and  a  damage  value  of  ttuo.  An  aperture  ts  a  component  for  light  inienstiy  control  located 
in  a  lens.  It  has  a  relative  importance  value  often  and  a  damage  value  of  five.  An  optical-lens  and 
it  have  a  different  class,  a  similar  type,  and  a  different  importance.  It  and  an  aperture  component, 
therefore,  are  similar  entities. 


GENNY.  August.  !987 


10.1  Aim  and  Scope 

The  aim  of  GENNY  was  to  produce  connected  and  focused  textual  responses  from  a  knowledge  base 
in  response  to  a  simulated  user  request  for  information  about  or  explanation  of  a  topic.  The  scope  for  the 
project  was  limited  to  definitions,  explanations  and  comparisons  of  KB  entities. 

10.2  Tests  and  Results 

GENNY  was  tested  by  generating  text  for  all  three  discourse  goals  (definition,  explanation,  comparison) 
for  a  variety  of  discourse  topics  (frames).  Topics  relating  to  frames  were  examined  at  all  levels  in  the  frame 
hierarchy.  A  second  knowledge  base  and  lexicon  were  developed  to  test  claims  of  domain  independency. 
Over  fifty  texts  were  generated  from  the  system  and  ten  representative  outputs  and  traces  are  included  in 
volume  II.  (see  Appendix). 

GENNY  generates  well-focused  and  connected  descriptions,  explanations,  and  comparisons  of  objects 
within  the  provided  knowledge  base.  The  system  failed  to  generated  output  (apologised)  if  the  discouise 
goal  was  not  represented  or  if  the  topic  (frame)  was  not  present  in  the  knowledge  base.  Also,  knowledge  base 
token  translation  failed  when  lexical  entries  were  not  present  in  the  dictionary,  although  the  system  degrades 
gracefully  by  attempting  to  realise  what  it  was  able  to  translate.  The  added  distinguishing  descriptive 
attributes  had  to  be  carefully  hand-encoded  or  else  errors  would  result  in  text  (e.g.  if  the  dda  fnr  brain  was 
‘‘(instrument  understanding)"  instead  of  “(function  understanding)”  we  would  get  “The  brain  is  a  region 
with  understanding”  instead  of  “for  understanding”. 
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10.3  Evaluation 

When  asked  to  compare  an  optical-lens  with  an  aperture,  GENNY  outputs  the  quote  at  the  beginning 
of  this  section,  which  demonstrates  results  similar  to  that  of  McKeown’s  [1985]  TEXT  system  (recognised 
as  the  state  of  the  art  in  text  generation  and  motivated  by  similar  discourse  needs).  In  response  to  a  similar 
discourse  goal  as  above,  What  is  the  difference  between  a  destroyer  and  a  bomb?,  the  TEXT  system  produces: 


A  destroyer  is  a  surface  ship  with  a  DRAFT  between  IS  amd  222.  A  ship  is  a  vehi¬ 
cle.  A  bomb  is  a  free  falling  projectile  that  has  a  surface  target  location.  A 
free  falling  projectile  is  a  lethal  destructive  device.  The  bomb  and  the  destroyer, 
therefore,  are  very  different  kinds  of  entities. 

GENNY  produces  produces  simitar  definitions  and  comparisons  as  TEXT  and,  in  addition,  investigates 
explanations  of  knowledge  base  entities.  This  is  partially  a  reflection  of  the  richer  (in  terms  of  discourse 
goals)  underlying  application  (expert  systems  versus  data  base  systems).  With  a  simulated  request  of  Why 
did  you  diagnose  Korsakoff’s  disorder?,  GENNY  responds: 


Korsakoffs  disorder  is  manifest  because  a  memory-iq  observation  smd  an  apathetic  ob¬ 
servation  indicate  damage.  The  memory-iq  observation  has  a  likelihood  value  of  nine. 
The  apathetic  observation  has  a  likelihood  value  of  ten. 

Due  to  limited  linguistic  forms  (lexical,  sentential,  and  textual)  GENNY's  output  can  become  boring. 
Fo^  example,  the  repetition  of  the  attributive  rhetorical  predicate  (“X  has  a  damage  value  of  five.")  for  all 
the  constituent  parts  of  an  entity  can  lead  to  annoying  textual  replications.  A  greater  number  of  possibilities 
in  the  schema  should  lead  to  richer  and  more  varied  text. 

The  claims  of  language  independency  were  (minimally)  tested  by  developing  a  small  Italian  dictionary, 
making  minor  modifications  to  the  syntactic  experts  (e.g.  position  of  adjectives  in  noun  phrases),  and 
modifying  the  morphological  synthesizer.  In  response  to  the  question,  What  is  a  brain,  GENNY  uttered 
(English  form  in  chapter  1): 


II  carvello  e  una  r«gion«  per  compransione  situata  nel  cranio  umano .  II  ha  una  val- 
ore  di  importanza  relatlva  di  dieci-  II  contiene  due  region!:  il  emiaphiro-della- 
sinietra  e  il  emiephiro-della-deetra.  II  emisphiro-della-sinietra  ha  una  valore 
di  lmport€Uiza  relative  di  died.  IX  omisphiro-della-deBtra  ha  \ma  valore  di  im¬ 
portanza  relative  di  died.  Il  emisphiro-della-destra ,  per  esempio,  ha  la  funzione 
compreneione-geetalt  situata  nel  cervello  destro. 

While  this  output  is  grammatical  and  natural  (as  oxamined  hv  a  native  Italian),  the  extent  nf  GENN^'  s 
language  independency  requires  rigorou.s  testing- 
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10.4  Discussion 

There  are  some  linguistic  phenomena  handled  by  TEXT  (e.g.  quantification)  which  ate  not  present  in 
GENNY.  This  was  a  reflection  of  time  constraints  rather  than  a  deficiency  in  the  linguistic  theory  presented 
and  could  be  incorporated  in  the  future.  GENNY  is  capable  of  generating  the  surface  forms  in  McKeown's 
system  (active,  passive,  and  thete-insertion  sentences)  but,  in  addition,  it-extraposition  for  emphasis  (driven 
by  focus  information). 

GENNY  includes  mechanisms  not  present  in  TEXT,  or  for  that  matter  in  other  NLG  systems.  GENNY 
refutes  the  fact  that  people  always  prefer  future  focus  to  current  focus  to  past  focus  (FF  >  CF  >  PF) 
and  instead  prefers  CF  >  FF  >  PF  when  there  are  multiple  foci.  Also,  GENNY’S  tactical  component 
(as  detailed  in  previous  sections)  is  principled  on  a  well-motivated  translation  from  message  formalism  to 
surface  form  via  relational  grammar.  In  TEXT,  no  linguistic  analysis  is  performed  on  KB  tokens:  they  are 
not  translated  but  used  directly  in  the  text.  Also,  in  GENNY,  referring  expressions  (anaphor)  and  lexical 
choice  (selection  of  indefinite  and  definite  articles)  was  guided  by  context  information  (given/new). 

Another  difference  lies  in  the  representation  of  knowledge.  McKeown  had  to  hand  encode  both  a 
generalisation  and  attribute  hierarchy.  In  contrast,  KB  modiflcation  for  linguistic  purposes  in  GENNY  was 
modest  (addition  of  a  DDA  for  each  entity).  Investigation  of  a  second  KB  (photography)  demonstrated  the 
domain  independence  of  the  system,  offering  support  for  the  higher  level  linguistic  theory. 

Like  TEXT,  GENNY  assumes  a  user  input  has  been  interpreted,  and  points  into  one  or  more  frames  in 
the  knowledge  base.  Similarly,  the  discourse  goal  (e.g.  explanation)  is  also  assumed  as  in  TEXT.  Interpre¬ 
tation  of  input  involves  non-trivial  issues  of  mapping  the  user  query  onto  knowledge  base  entities  and  will 
have  to  be  addressed  in  generation  systems  of  the  future. 

The  potential  degree  of  system  portability  remains  to  be  tested  by  interfacing  to  other  applications 
such  as  a  data  base  or  a  rule-based  expert  system.  Furthermore,  claims  of  language-independence  must 
be  fully  tested.  Extensive  experimentation  is  still  required  to  examine  the  robustness  of  the  knowledge 
representation  and  knowledge  selection  procedures,  particularly  for  expert  systems  outside  of  the  causally 
related  fault-diagnosis  paradigm  or  those  which  have  larger  quantities  of  knowledge.  Testing  with  even  longer 
texts  and  contexts  should  reveal  the  efficacy  of  the  text  schema  to  impose  a  global  framework  and  the  local 
focus  constraints  to  encourage  local  connectivity. 
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Chapter  11 


CONCLUSION 

Ancora  imparo. 

Mich«i«nge}o  Buonarroti 

11.1  Summary 

This  dissertation  focuses  on  the  key  issue  of  NLG:  generation  under  constraints.  GENNY  investigates 
these  constraints  on  the  spectrum  from  discourse  to  syntax.  First  a  linguisticaJly  motivated  framework  of 
NLG  was  developed  and  then  a  computational  model  for  realizing  this  was  designed  and  implemented. 

The  linguistic  issues  investigated  in  GENNY  include  the  analysis  of  common  communicative  strate¬ 
gies  found  in  human-produced  text  and  the  well-motivated  translation  of  a  rhetorical  message  onto  surface 
form.  The  computational  model  of  generation  implemented  involved:  the  development  and  incotpotation 
of  high  level  text  structures  from  natural  texts;  focus  algorithms  (global  and  local)  for  realization  of  the 
Gricean  maxim  of  relevancy;  a  multi-level  grammatical  representation  with  particular  emphasis  on  the  role 
of  language-independence;  and  mechanisms  for  improving  textual  coherence  and  plausibility  (discourse  plans, 
lexical  connectives,  and  context-guided  article  selection). 

11.2  Contributions 

In  contrast  to  previous  work,  GENNY  incorporates  both  domain-independent  linguistic  structures 
{theme-schemes  -  developed  from  analysis  of  natural  texts)  as  well  as  a  language-independent  grammar 
formalism  (RG).  GENNY  suggests  algorithms  for  sticking  to  the  point,  moving  from  one  focus  to  another, 
deciding  what  words  to  use,  as  well  as  deciding  how  to  order  them.  GENNY  als''  illustrates  the  promise  of 
bi-directional  grammars  and  dictionaries. 

In  theoretic  terms,  the  system  holds  promise  as  a  well-motivated  linguistic  representation  which  can 
be  used  for  both  generation  and  interpretation.  In  pragmatic  terms,  it  is  suggestive  of  a  (domain  and  KR) 
portable  and  (language)  universal  system. 
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11.3  Limitations 

The  system’s  greatest  limitation  is  the  minimal  pragmatic  analysis  (i.e.  no  user  modeling,  limited 
analysis  of  Gricean  maxims).  This  both  a  reflection  of  time  constraints  coupled  with  a  need  for  more 
theoretical  research  on  these  difficult  higher  level  linguistic  phenomena. 

GENNY  incorporates  no  creative  expression.  For  example,  old  words  could  be  coupled  together  to  create 
new  expressions  utilising  the  semantic  lexical  features  together  with  some  amalgamation  routines.  Also, 
there  is  no  self-monitoring  where  the  program  **listens  to  itself'  to  detect  ambiguity  (lexical,  structural,  or 
referential).  Furthermore,  there  is  no  post-editing  for  style  to  ensure  a  message  or  discourse  realizes  smoothly 
and  cogently.  Finally,  the  anaphoric  analysis  requires  more  sophisticated  mechanisms  which  incorporate  both 
locutionary  and  illocutionary  knowledge.  Th^e  issues  suggest  future  paths  of  research. 

11.4  Future  Directions 

The  new  frontiers  include  universality,  discourse  modelling  (text  coherence  and  cohesion),  and  audience 
modelling.  Future  generators  need  also  to  address  pragmatic  issues  such  as  setting  (e.g.  speaker  and  hearer 
goals  and  relationships),  and  how  they  effect  surface  decisions.  Mote  sophisticate  d  syntactic  structures  and 
their  relation  to  focus  need  to  be  investigated  including:  parallel  sentence  strncture,  subordinate  sentences, 
and  textual  connectives. 

Only  after  the  difficult  issues  of  universality,  discourse  and  pragmatics,  and  user  modelling  are  fully 
tackled  will  effective  practical  generators  emerge.  Then  we  will  be  able  to  translate  indirect  intention,  deal 
sufficiently  with  co-reference,  and  generate  not  only  connected  and  plausible,  but  also  sophisticated  text. 
But  then  again,  Shakespeare  didn’t  learn  to  write  poetry  overnight. 
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System  Trace  and  Textual  Output 
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Tutt  S«p  1  09:17:04  1907 


Wha t_l r • i B 7 

Prana  Liep,  Opus  39.79 
->  (includa  Bain) 

(faal  Bain.o] 

WalcoB#  to  tha  QENNY  taxt  9anaratlon  ayataa  for  axpart  lyataBs. 
QINMY  waa  daaignad  to  anawar  quaationa  of  tha  fora: 

—  What  ia  an  X7 

—  Why  did  you  dlagnoaa  Y?  or  Why  doaa  Y  hava  a  problan? 

—  What  la  tha  dlffaranca  batwaan  X  and  Y? 

whara  X  and  Y  ara  antitiaa  within  tha  providad  knowiadga  baea. 

Thaaa  thraa  typaa  of  quaationa  ara  indlcatad  by  tha  kayworda: 
DEPIHE,  EXPLAIN,  and  COMPARE,  raapactlvaly . 


Plaaaa  antar  tha  doaain  dictionary  flla  naaa?  nauropsychology . diet 
[load  nauropaychology . diet ) 

What  la  tha  doBaln  of  diacouraa?  nauropaychology . kb 
(load  nauropaychology. kb] 

Do  you  wiah  DEFINE,  EXPLAIN,  or  COMPARE?  dafina 
What  do  you  wlah  to  know  about?  brain 


TEXT  SKETCH: 

Introduction 

daacriptlon 

exanola 

SELECT  KNOWLEOOE  VISTA  mm>  ((brain)  brain  laft-hamlapKaca  rlght^hamlaphara  human) 
GENERATE  RELEVANT  PROPOSITION  POOL 
GENERATE  DISCOURSE  SKETCH; 

(dafinition  attributlva  eonatltuant  attributiva  attrlbutiva  illustration) 

GLOBAL  FOCUS  (TOPIC)  ••>  (brain) 

LOCAL  FOCUS  CHOICES  (FF/CP/PP)  ■«>  (brain) 

PREDICATE  SELECTED  «■> 

(dafinition  ((brain)) 

( ( ragion) ) 

((location  (skull  human))  (function  (undaratandlng ) ) ) ) 

LOCAL  FOCUS  CHOICES  (FF/CF/PF)  (ragion  brain) 

PREDICATE  SELECTED  «•> 

(attrlbutiva  ((brain))  ((valua  importanca  Indaf  tan  ralativa))) 

LOCAL  FOCUS  CHOICES  (FF/CP/PF)  -•>  (valua  brain) 

PREDICATE  SELECTED  »«> 

(eonatltuant  ((brain)) 

( ( ragion  two  nona  )  ) 
nil 

((ragion  laf t-hanisphara )  (ragion  rlght-hanlaphara ) ) ) 

LOCAL  FOCUS  CHOICES  (PP/CF/PP)  >«>  (ragion  laft-hamiaphara  right-hamiaphara  brain) 
PREDICATE  SELECTED  »> 

(attrlbutiva  ( ( laf t'^hamiapha ra ) )  ((valua  importanca  indaf  tan  ralativa))) 

LOCAL  FOCUS  CHOICES  (FF/CF/PF)  »»>  (valua  laft-hamiaphara  ragion  right-hamisphare  brain) 
PREDICATE  SELECTED  «•> 

(attrlbutiva  ( ( right-hamiaphara )  )  ((valua  importanca  indaf  tan  ralativa)}) 

LOCAL  FOCUS  CHOICES  (FF/CF/PF)  =»>  (valua  right-hamisphara  ragion  la f t-hami spha i a  brain) 
PREDICATE  SELECTED  •«> 

( lllua t rat ion  ((ragion  right-hamisphara))  ((function  gestalt-undarstanding ) ) ) 


RHETORICAL  PREDICATE 


(dafinition  ((brain)) 

( { ragion ) ) 

((location  (skull  human))  (function  (undaratandlng)))) 
PRAGMATIC  FUNCTION  ( dl scou r a a-t opl c-ant 1 ty/f ocua/gl van )  ' 

((brain)  (nil  (brain)  (ragion))  nil) 
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SEMANTIC  FUNCTION  : 

action  agant  patiant  Inat  loc  funct  mannar  tiaa 

(ba  ((brain)}  ((ragion))  nil  (akull  human)  (undarstanding )  nil  nil  nil  nil) 


RELATIONAL  FUNCTION  (voica  and  form)  :  (actlva) 

LEXICAL  INPUT  TO  SENTENCE  OENERATOR: 

(  (a 

(idatarminar  count  alnglp  Indafart  notof  nonag  nonum) 

(articla  bafora  consonant) 
a )  ) 

(brain  ((noun  count  alnglp  nautar)  raglon  brain)) 

(ba  ((copula  plur  pras  p3 ) 

(L  (_P)  (L  (_%rH)  (_P  (L  (_y)  (agual  _WH  _y ) )  ) )  ) 

ara )““ 

((copula  aingSp  pras  p3 ) 

(L  (  P)  (L  (_WH)  (_P  (L  (  y)  (aqual  _y))))) 

is ) 

((copula  sing  pras  pi) 

(L  (_P)  (L  (_WH)  (_P  (L  (_y)  (aqual  __WH  _y))))) 

am)  ) 

( a 

((datarminar  count  slngSp  indafart  notof  nonag  nonum) 

(articla  bafora  consonant) 
a)  ) 

(ragion  ((noun  count  1  nautar)  ragion  raglon)) 

(for  ((connactiva  for-axampla)  for  for) 

((proposition)  (indicating  purposa)  for)) 

(undarstanding  ((noun  mass  1  nautar)  consciousnass  undarstanding ) ) 

(locatad  ( (praposition  locatad-in)  (locatad-in)  locatad)) 

(in  (  (praposition  an)  ( containad->in )  in) 

((proposition  locatad-in)  (locatad-in)  in) 

((proposition)  (innar  or  inward  location)  in)) 

( tha 

((datarminar  count  1  dafart  notof  nonag  nonum)  (sing/plur  form  of  tha)  tha)) 
(human  ((noun  count  1  nautar)  human  human)) 

(skull  ((noun  count  1  nautar)  (cranial  eontainar  and  protaetor)  skull))) 
SYNTAX  OUTPUT  FROM  SENTENCE  OENERATOR: 


(((8  daelarativa  actlva) 

((np  sing3p  p3  nautar) 

((datarminar  count  sing3p  indafart  notof  nonag  nonum)  ((a))) 

((nl  singSp  nautar)  ((noun  count  singSp  nautar)  (;brain))))) 

((vp  singSp  p3  pras  activa) 

((copula  8ing3p  pras  p3)  ((is))) 

((np  singSp  p3  nautar) 

((np  elng3p  p3  nautar) 

((np  sinqSp  p3  nautar) 

((datarminar  count  singSp  indafart  notof  nonag  nonum)  ((a))) 

((nl  singSp  nautar)  ((noun  count  singlp  nautar)  ((ragion))))) 

Mpp) 

((proposition)  ((for))) 

((np  8ing3p  p3  nautar)  ((noun  mass  singSp  nautar)  ((undarstanding)))))) 
(  (pp) 

( (proposition  locatad-in)  < (locatad) ) ) 

((proposition  locatad-in)  ((in))) 

( (np  27  p3  nautar ) 

((datarminar  count  15  dafart  notof  nonag  nonum)  ((tha))) 

( (nl  27  nautar ) 

((noun  count  21  nautar)  ((human))) 

((noun  count  27  nautar)  ((skull))))))))) 

((s  daelarativa  activa) 

((np  8ing3p  p3  nautar) 

((datarminar  count  slng3p  indafart  notof  noneg  nonum)  i<a}}) 

((nl  singSp  nautar)  ((noun  count  sing3p  nautar)  ((brain))))) 

((vp  aingSp  p3  pras  actlva) 

((copula  sing3p  pras  p3)  ((is))) 

((np  8ing3p  p3  nautar) 

((np  singSp  p3  nautar) 

((datarminar  count  singSp  indafart  notof  nonag  nonum)  {i%))) 

((nl  aingSp  nautar)  ((noun  count  8ing3p  nautar)  ((ragion))))) 

Mpp) 

( (proposition)  ( ( for ) ) ) 

((np  aingSp  p3  nautar) 

( (np  aing3p  p3  nautar) 

((noun  mass  aing3p  nautar)  ((undarstanding)))} 

(  (pp) 

( (praposition  locatad-in)  { (locatad) ) ) 

( (prapoaitlon  locatad-in)  ((in))) 

( (np  27  p3  nautar ) 

((datarminar  count  15  dafart  notof  nonag  nonum)  ((tha))) 

( (nl  27  nautar ) 
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((noun  count  21  noutoc)  ((huMon))) 

((noun  count  27  ooutor)  (( skull ) M ) M  H /) H 


mmmmmmmm  RHETORICAL  PREDICATE 

(sttrlbutlvs  ((brain))  ((valus  laportanca  indof  tan  ralativa))) 
PRAOMATIC  FUNCTION  ( dlBcoursa-toplc-antlty/focus/givan ) 

((brain)  (((brain))  (brain)  (valua))  (brain  ragion)) 


SEMANTIC  FUNCTION  : 

action  agant  patlant  inst  loc  funct  »annar  ti»a 
(hava  ( (brain)  ) 

((valua  laportanca  indaf  tan  ralativa)) 

nil 

nil 

nil 

nil 

nil 

nil 

nil) 


RELATIONAL  FUNCTION  (voica  and  lorn)  :  (activa) 

LEXICAL  INPUT  TO  SCHTENCL  GENERATOR: 

((it  ((pronoun  pars  aingSp  subj  p3  nautar)  (a  thing)  it)) 

(hava  ({hava-v  ainglp  pras  p3)  (to  own  or  poaaas  •  irragular  |3p|  aing)  has) 
((havs'-v  plur  pras  pi)  (to  own  or  posass)  hava) 

((hava*-v  sing  pras  pi)  (to  own  or  posass)  hava)) 

( a 

((datarninar  count  singlp  indalart  notof  nonag  nonum) 

(articla  bafora  consonant) 

« )  ) 

(ralativa  ((adjactiva  attributiva)  ralativa  ralativa)) 

(inportanca  ((noun  count  1  nautar)  inportanca  inportanca)) 

(valua  ((noun  count  1  nautar)  valua  valua)) 

(of  ((proposition)  (placa  of  origin)  of)) 

(tan  ((nunbar  plur)  (laxical  raprasantatlon  of  nunbar  10)  tan))) 

SYNTAX  OUTPUT  FROM  SENTENCE  GENERATOR: 


(((8  daclarativa  activa) 

((np  singSp  p3  nautar)  ((pronoun  pars  singSp  subj  p3  nautar)  ((it)))) 
( ( vp  singSp  p3  pras  activa) 

((hava-v  singlp  pras  p3 )  ((has))) 

( ( np  8ing3p  p3  nautar) 

( ( np  singSp  p3  nautar) 

((datarninar  count  singlp  indafart  notof  nonag  nonus)  ((a))) 

((nl  singSp  nautar) 

((adjp  attributiva)  ((adjactiva  attributiva)  ((ralativa)))) 

((nl  sing3p  nautar) 

((noun  count  3  nautar)  ((inportanca))) 

((noun  count  8ing3p  nautar)  ((valua)))))) 

((pp)  ( ( prapos it  ion )  ((of)))  ((nunbar  plur)  ((tan)})))))) 


RHETORICAL  PREDICATE  = 


(  cons**  ♦’’.lar*  Mbrain)) 

((ragion  two  nona)) 
nil 

((ragion  laf t-hani sphara )  (ragion  r ight-hamispha ra ) ) ) 
PRAOMATIC  FUNCTION  (  discour s a-*t opi c-ant i  ty/f  ocus/gi van ) 

( (brain ) 

(((brain)  (brain))  (brain)  (ragion  laf t^hanisphara  right-hanisphara ) ) 
(brain  valua  ragion)) 


SEMANTIC  FUNCTION  : 

action  agant  patiant  inst  loc  funct  nannar  tlna 
(contain  ( (brain)  ) 
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Whmt  is  s  brain? 


((region  two  non«)| 

nil 

nil 

nil 

nil 

((region  left-heai sphere) 

nil 

nil ) 


(region  right-heaisphere)) 


RELATIONAL  FUNCTION  (voice  and  forn)  (active  colon-insertion) 

LEXICAL  INPUT  TO  SENTENCE  GENERATOR: 

((It  ((pronoun  pers  singSp  subj  p3  neuter)  (a  thing)  it)} 

(contain  ({trana  aing3p  prea  p3)  (restricted  or  otherwise  United}  contain) 
((trans  plur  prea  p3)  (restricted  or  otherwise  United)  contain)) 
(two  (Inunbar  plur)  (lexical  representation  of  nunber  2}  two)) 

(region  ((noun  count  1  neuter)  region  region)) 

(colon  ((colon)  colon  colon)) 

( the 

((daterniner  count  1  defart  notof  noneg  nonun)  (sing/plur  form  of  the)  the)) 
( lef t-henisphere  ((noun  count  sing3p  neuter)  region  lef t-henisphere ) ) 

(region  ((noun  count  1  neuter)  region  region)) 

(and  ((conjunction  coord)  (intersection)  and)) 

( the 

((daterniner  count  1  defart  notof  noneg  nonun)  (sing/plur  forn  of  the)  the)) 
( right-henisphere  ((noun  count  slngSp  neuter)  region  r ight-heni sphere ) ) 
(region  ((noun  count  1  neuter)  region  region))) 

SYNTAX  OUTPUT  PROM  SENTENCE  GENERATOR: 


(((8  declarative  active) 

(tnp  eing3p  p3  neuter)  ((pronoun  pecs  singSp  subj  p3  neuter)  ((it)))) 
((vp  sing3p  p3  pres  active) 

((trana  singlp  pres  p3)  {(contain))) 

((np  plur  p3  neuter) 

( (np  plur  p3  neuter ) 

((nunber  plur)  ((two)}) 

((nl  plur  neuter)  ((noun  count  plur  neuter)  (( region ))}) ) 

(( colon )  ( ( colon ) ) ) 

((np  plur  p3  neuter) 

( (np  15  p3  neuter ) 

((daterniner  count  9  defart  notof  noneg  nonum)  ((the)}) 

( (nl  15  neuter ) 

((noun  count  sing3p  neuter)  (( lef t-henisphere )) ) 

((noun  count  15  neuter)  ((region))))) 

((conjunction  coord)  ((and)}) 

( (np  27  p3  neuter ) 

((daterniner  count  21  defart  notof  noneg  nonum)  ((the))) 

( ( nl  27  neuter ) 

((noun  count  eing3p  neuter)  ((right-hemisphere))) 

((noun  count  27  neuter)  ((region))))))))) 

((s  declarative  active) 

((np  8ing3p  p3  neuter)  ((pronoun  pars  sing3p  subj  p3  neuter)  ((it)))) 
((vp  slngSp  p3  pres  active) 

((trans  8ing3p  pres  p3}  ((contain))) 

((np  plur  p3  neuter) 

((np  plur  p3  neuter) 

((np  plur  p3  neuter) 

((number  plur)  ((two))) 

((nl  plur  neuter)  ((noun  count  plur  neuter)  ((region))))) 

(( colon )  (( colon )) ) 

( (np  15  p3  neuter ) 

((determiner  count  9  defart  notof  noneg  nonum)  ((the))} 

( ( nl  15  neuter ) 

((noun  count  singlp  neuter)  ((left-hemisphere))) 

((noun  count  15  neuter)  ((region)))))) 

((conjunction  coord)  ((and))) 

(  (np  27  p3  neuter ) 

((determiner  count  21  defart  notof  noneg  nonum)  ((the))) 

(  (nl  27  neuter ) 

((noun  count  singSp  neuter)  ( ( r i ght-h*mi sphe re ) > ) 

((noun  count  27  neuter)  ((region))))))))) 


rnmmmmmmm  RHETORICAL  PREDICATE 

(attributive  ((left-hemisphere))  ((value  importance  indef  ten  relative))) 
PRAGMATIC  FUNCTION  ( di 8 cou r se- t opic-ent 1 ty/f ocus/gi van ) 
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( ( laf t-ha»l8ph«ra ) 

(((brain)  (brain)  (brain))  ( laf t-hasisphara )  (valua)) 
(brain  ragion  laft-haniaphara  right-haaiaphara  valua)} 


SEMANTIC  FUNCTION  : 

action  agant  patiant  inst  loc  funct  aannai  tiaa 
()iava  (  (laft-haaiaphara)  ) 

((valua  iaportanca  indaf  tan  ralatlva)) 

nil 

nil 

nil 

nil 

nil 

pil 

nil ) 


RELATIONAL  FUNCTION  (voica  and  fora)  ;  (activa) 

LEXICAL  INPUT  TO  SENTENCE  GENERATOR: 

(  (tha 

((datarnlnar  count  1  dafart  notof  nonag  nonun)  (aing/p^ur  form  of  tha)  tha)) 
( laft-hamiaphara  ((noun  count  ainglp  nautar)  ragion  laft-hamisphara )  ) 

(hava  {(hava-v  singlp  pras  p3)  (to  own  or  posass  -  irragular  |3p|  sing)  has) 
((hava-v  plur  pras  pi)  (to  own  or  posasa)  hava) 

((hava~v  sing  pras  pi)  (to  own  or  poaass)  hava)) 

(  a 

((datarninar  count  aingSp  indafart  notof  nonag  nonum) 

(articla  bafora  consonant) 
a  )  ) 

(ralativa  ((adjactiva  attributiva)  ralativa  ralativa)) 

(inportanca  ((noun  count  1  nautar)  iaportanca  importanca)) 

(valua  ((noun  count  1  nautar)  valua  valua)) 

(of  ( ( praposit ion )  (placa  of  origin)  of)) 

(tan  ((numbar  plur)  (laxical  raprasantation  of  nunbar  10)  tan))] 

SYNTAX  OUTPUT  FROM  SENTENCE  GENERATOR: 


(((8  daclarativa  activa) 

((np  singSp  p3  nautar) 

((datarminar  count  3  dafart  notof  nonag  nonum)  ((tha))) 

((nl  sing3p  nautar)  ((noun  count  singlp  nautar)  ( ( laft-hamisphara  )  )  )  )  ) 
((vp  sing3p  p3  pras  activa) 

((hava-v  8ing3p  pras  p3)  ((has))) 

((np  sing3p  p3  nautar) 

((np  singSp  p3  nautar) 

((datarninar  count  singlp  indafart  notof  nonag  nonum)  {(a))) 

( ( nl  Bing3p  nautar ) 

((adjp  attributiva)  ((adjactiva  attributiva)  ((ralativa)))) 

((nl  singSp  nautar) 

((noun  count  9  nautar)  ((importanca))) 

({noun  count  sing3p  nautar)  ((valua)))))) 

((pp)  (( proposition  )  ((of)))  ((nunbsr  plur)  (( t an  })}))))  ) 


»  RHETORICAL  PREDICATE  *  » 


(attributiva  ( ( right-hamisphara ) )  ((valua  inportanca  indaf  tan  ralativa))) 
PRAGMATIC  FUNCTION  | di s cou r sa - t op i c-an t i t y/f ocus/g i ve n )  ; 

( (right-hamisphara) 

(((ragion  laft-hamisphara  r ight-hami spha r a )  (brain)  (brain)  (brain)) 

( right-hamisphara ) 

( valua  )  } 

( laf t-hamisphara  valua  brain  ragion  right-hamisphara*' 


SEMANTIC  FUNCTION  : 

action  agant  patiant  inst  loc  funct  mannar  tima 
(hava  ((right-hamisphara)) 

((valua  importanca  indaf  tan  ralativa)) 

nil 

nil 

nil 

nil 

nil 

nil 

nil ) 


Tu«  S«p  X  09:17:05  1987 


What  is  a  brain? 


RELATIONAL  FUNCTION  (voica  and  fora)  :  (activa) 

LEXICAL  INPUT  TO  SENTENCE  QGMERATOR: 

<  (tha 

((datarninar  count  1  dafart  notof  nonaq  nonun)  ising/plur  fora  of  tha)  tha)) 
I rlght-hanlaphara  ((noun  count  ainglp  nautar)  ragion  right-hani spha ra ) ) 

(hava  ((hava-v  singBp  praa  p3)  (to  own  or  poaaas  ~  irragular  |3p|  sing)  has) 
((hava-v  plur  pras  pi)  (to  own  or  poaaas)  hava) 

((hava-v  eing  praa  pi)  (to  own  or  poaasa)  hava)) 

( a 

((datarninar  count  alng3p  indafart  notof  nonag  nonun) 

(artlcla  bafora  consonant) 
a)  ) 

(ralativa  ((adjactiva  attributiva)  ralativa  ralativa)) 

(inportanca  ((noun  count  1  nautar)  inportanca  inportanca)) 

(valua  ((noun  count  1  nautar)  valua  valua)) 

(of  ( (prapoaltion )  (placa  of  origin)  of)) 

(tan  ((nunbar  plur)  (laxlcal  rapraaantation  of  nunbar  10)  tan))) 

SYNTAX  OUTPUT  PROM  SENTENCE  GENERATOR: 


(((s  daclaratlva  activa) 

((np  aingSp  p3  nautar) 

((datarninar  count  3  dafart  notof  nonag  nonun)  ((tha))) 

((nl  sing3p  nautar)  ((noun  count  singlp  nautar)  (( right-hani spha ra )))) ) 
((vp  sing3p  p3  praa  activa) 

((hava-v  aing3p  praa  p3)  ((has))) 

( ( np  ainglp  p3  nautar) 

((np  8ing3p  p3  nautar) 

((datarninar  count  sing3p  indafart  notof  nonag  nonum)  ((a))) 

((nl  8ing3p  nautar) 

((adjp  attributiva)  ((adjactiva  attributiva)  ((ralativa)))) 

((nl  8ing3p  nautar) 

((noun  count  9  nautar)  (  (  i’^portanca  )  )  ) 

((noun  count  8ing3p  nautar)  ((valua)))))) 

((PP)  ((prapoaltion)  ((of)))  ((nunbar  plur)  ((tan)})))))) 


RHETORICAL  PREDICATE 


(illustration  ((ragion  right-hanlsphara ) )  ( ( function  gastalt-undar standing ) ) ) 

PRAGMATIC  FUNCTION  ( di s cour s a-topic-ant i ty/f ocus/g i van ) 

(  (right-haiaisphara) 

( ( ( right-hanisphara) 

(ragion  laft-hamlsphara  right-hawlsphara) 

(brain ) 

(brain ) 

(brain ) } 

(right-hanisphara) 

( gas t al t-unda  cstanding) ) 

( right-hamiaphara  valua  laf t-hanlsphara  brain  ragion}} 


SEMANTIC  FUNCTION  : 

action  agant  patiant  inst  loc  funct  laannar  tima 
(hava  ((ragion  right-hanisphara)) 

( (function  gas tal t-undar 8 bonding ) ) 

nil 

nil 

nil 

nil 

nil 

nil 

nil ) 


RELATIONAL  FUNCTION  (voica  and  form)  (activa  axampla-inse r t ion ) 

LEXICAL  INPUT  TO  SENTENCE  GENERATOR: 

(  (tha 

((datarninar  count  1  dafart  notof  nonag  nonun)  (sing/plur  forn  of  tha)  tha)} 
(right-hanisphara  ((noun  count  singlp  nautar)  ragion  right-hanisphara)) 
(ragion  ((noun  count  1  nautar)  ragion  ragion)) 

(conna  ((conna)  conna  conna)) 

(for  ((connactiva  for-axanpla)  for  for) 

((prapoaltion)  (indicating  purposa)  for)) 

(axanpla  ((connactiva  for-axanpla)  axanpla  axanpla) 

((noun  nasB  1  nautar)  axanpla  axanpla)) 
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(coB««  ((coaaa)  coaaa  coaaa n 

(bav«  ((h«v*~v  Bln93p  pr«s  p3)  (to  own  or  pososs  -  irrogular  |3p|  sing)  has) 
((havo-v  plur  pros  pi)  (to  own  or  posass)  hava) 

{(hava*-v  sing  pras  pi)  (to  own  or  posass)  hava)) 

( tha 

((datarnlnar  count  1  dafart  notof  nonag  nonun)  (slng/plur  fora  of  tha)  tha)) 
( gastalt-undarstandlng  ((noun  nass  1  nautar)  function  gastalt-undarstanding ) ) 
(function  ((noun  count  1  nautar)  function  function) 

((varb  trans  sing3p  pras  pi)  (tailing)  function) 

((varb  trans  plur  pras  p3 )  (tailing)  function))) 

SYNTAX  OUTPUT  PROM  SENTENCE  GENERATOR: 


(({8  daclarativa  activa) 

( ( np  9  p3  nautar  ) 

( (np  9  p3  nautar ) 

{  ( datarsiinar  count  3  dafart  notof  nonag  nonun)  ((tha))) 

( (nl  9  nautar ) 

((noun  count  singlp  nautar)  ( ( right-hanl sphara ) ) ) 

((noun  count  9  nautar)  ( ( ragion ) ) ) ) ) 

( ( conaa )  ( ( conna ) ) ) 

((ral  for-aaanpla) 

((connactiva  for-axaapla)  ((for))) 

( (connaetiva  for-axaapla)  ( ( axaapla ) ) ) ) 

( ( conaa )  ( ( coana ) ) ) ) 

((vp  singSp  p3  pras  activa) 

((hava-v  slngSp  pras  p3)  ((has))) 

( ( np  33  p3  nautar ) 

((datarainar  count  21  dafart  notof  nonag  nonua)  ((tha))) 
( ( nl  33  nautar ) 

((noun  aass  27  nautar)  ((gastalt-undarstanding))} 

((noun  count  33  nautar)  ((function))))))) 

((s  daclarativa  activa) 

( { np  9  p3  nautar ) 

( ( np  9  p3  nautar ) 

((datarainar  count  3  dafart  notof  nonag  nonua)  ((tha))) 

( (nl  9  nautar ) 

((noun  count  sing3p  nautar)  ( ( right-haalsphara ) ) ) 

((noun  count  9  nautar)  ((ragion))))) 

( ( coaaa )  ( ( coaaa ) ) ) 

((cal  for-axaapla) 

( ( connactiva  for-axaapla)  ((for))) 

( (connactiva  for-axaapla )  ( ( axaapla ) ) ) ) 

( ( coaaa )  ( ( conaa ) ) ) ) 

((vp  plur  p3  pras  activa) 

((hava-v  plur  pras  pi)  ((hava))) 

( (np  33  p3  nautar ) 

((datarainar  count  21  dafart  notof  nonag  nonun)  ((tha))) 
( (nl  33  nautar ) 

((noun  aass  27  nautar)  ( (gostalt-undarstanding ) ) ) 

((noun  count  33  nautar)  ((function))))))) 

((8  daclsratlva  activa) 

( ( np  9  p3  nautar ) 

((np  9  p3  nautar) 

((datarainar  count  3  dafart  notof  nonag  nonua)  ((tha))) 

(  ( nl  9  nautar ) 

((noun  count  singSp  nautar)  ( ( rlght-haaisphara ) ) ) 

((noun  count  9  nautar)  ((ragion))))) 

( (coaaa)  ( (coaaa) ) ) 

( ( ral  for-axaapla ) 

((connactiva  for-axaapla)  ((for))) 

((connactiva  for-axaapla)  ((axaapla)))) 

( ( coaaa )  ( ( coaaa ) ) ) ) 

( ( vp  sing  p3  pras  activa) 

((hava-v  sing  pras  pi)  ((hava))) 

( ( np  33  p3  nautar) 

((datarainar  count  21  dafart  notof  noneg  nonum)  ((the))) 
( (nl  33  nautar ) 

((noun  aass  27  nautar)  ( (gastslt-understanding ) ) ) 

((noun  count  33  nautar)  ((function)))))))) 


DISCOURSE  STRUCTURE  +  FOCUS  GIVEN 

( ( { daf Inition  ((brain)) 
f ( ragion) ) 

((location  (skull  huasn))  (function  (undarstsnding ) ) ) ) 
(nil  (brain)  (ragion)) 
nil ) 

( ( attrlbutl va  ((brain))  ((valua  iaportsnca  indaf  tan  ralstiva))) 
(((brain))  (brain)  (valua)) 

(brain  ragion )  ) 

( (constituant  ((brain)) 

((ragion  two  nona)) 
nil 
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( ( region  l«ft-h«Biflph*r«)  ( region  right-haaisph^r* ) ) ) 
(((br«in>  (brain))  (brain)  (raglon  laf t-haalaphara  rlght-hanlsphara ) ) 
(brain  valua  ragien)) 

( (attributlva  ( ( laf t-haalaphara ) )  ((valua  laportanca  Indaf  tan  ralativa))) 
(((brain)  (brain)  (brain))  ( latt-haalaphara )  (valua)) 

(brain  raglon  laf t-hanlsphara  right-haniaphara  valua)} 

((attributlva  ( ( r ight-hani sphara ) )  ((valua  InportaAca  indaf  tan  ralativa))) 
(((raglon  laf t-haalaphara  right-haniaphara )  (brain)  (brain)  (brain)) 

( right-haniaphara ) 

( valua ) ) 

( laf t-haniaphara  valua  brain  raglon  right-haniaphara) ) 

( ( illuatration  ((raglon  rlght-haniaphara ) ) 

( ( function  gaatalt-undaratanding ) ) ) 

( ( ( right-haaiaphara ) 

(raglon  laf t-haniaphara  right-haatiaphara) 

(brain ) 

( brain ) 

(brain) ) 

( right-haniaphara ) 

( gaatalt-undaratandlng ) ) 

(right-haniaphara  valua  iaf t-haniaphara  brain  raglon))) 


MESSAGE  REALIZATION 

({a  brain  ia  a  raglon  for  undarstanding  locatad  in  tha  human  b)(u11) 
(it  haa  a  ralativa  Inportanca  valua  of  tan) 

(it  containa 
two 

ragiona 

colon 

tha 

laft-hanlaphara 

raglon 

and 

tha 

right-haniaphara 
raglon ) 

(tha  laft-hanlaphara  haa  a  ralativa  inportanca  valua  of  tan) 

(tha  right-haniaphara  has  a  ralativa  inportanca  i/alua  of  tan) 

( tha  right-haniaphara 
raglon 
conna 
for 

axanpla 

eonna 

haa 

tha 

gas talt-undara tan ding 
function ) ) 


SURFACE  FORM 

A  brain  is  a  raglon  for  undarstanding  locatad  in  tha  human  8)(ull. 

It  has  a  ralativa  inportanca  valua  of  tan. 

It  contains  two  ragions:  tha  laft-hamisphara  ragion  and  tha  right-hanisphara  raglon. 
Tha  laf t-hanlaphara  has  a  ralativa  inportanca  valua  of  tan. 

^  Tha  right-hanisphara  has  a  ralativa  inportanca  valua  of  tan. 

Tha  right-hanisphara  ragion,  for  axanpla,  has  tha  gastalt-undarstanding  function. 


nil 

->  (  ?-.it ) 


